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STRUCTURING  DECISIONS :  THE  ROLE  OF  STRUCTURING  HEURISTICS 


BRIEF 


Requirement: 

To  investigate  if  and  how  subjective  judgmental  heuristics  can  be  incor¬ 
porated  into  a  computer  interactive  decision-making  aid. 


Procedure: 

Review  and  critiques  of  the  following  topics  were  made:  the  development 
of  decision-theoretic  systems,  decision  theory,  heuristic  devices,  and  classi¬ 
fication  of  heuristics.  A  computer  aid  was  developed  using  heuristics  to  sup¬ 
port  the  structuring  and  evaluation  of  a  decision  or  problem. 

Findings : 

The  current  view  of  judgmental  heuristics  as  biases  is  challenged  on  the 
grounds  that  the  biasing  nature  of  some  of  the  heuristics  has  not  been  repli¬ 
cated  in  the  degree,  and,  in  some  cases,  in  the  direction  of  the  bias.  An  al¬ 
ternative  is  to  view  heuristics  as  devices  for  integrating  the  decision  maker 1 a 
semantic  memory  with  the  decision- theoretic  techniques.  In  addition,  it  was 
possible  to  identify  areas  in  the  decision-making  process  in  which  heuristic 
rather  them  normative  algorithmic  procedures  should  be  used.  A  comprehensive 
categorization  of  heuristics  was  generated.  A  decision  aid,  Multiattribute 
Utility  Decomposition  (MAUD) ,  is  used  to  demonstrate  how  heuristic  devices 
can  be  used  to  handle  the  transactions  across  the  decision-theoretic  computer¬ 
ized  system  and  the  decision  maker's  semantic  memory.  Specifics  on  the  MAUD 
system  are  summarized  in  Technical  Report  543. 

i 

i 

Utilization  of  Findings:  1 

This  report  will  be  of  use  to  those  interested  in  understanding  the 
psychological  means  of  supporting  decision  making.  Due  to  their  technical  and 
exploratory  nature,  the  materials  presented  will  be  of  limited  value  for  imme¬ 
diate  application.  Rather,  their  merits  will  be  realized  as  a  stimulus  for 
researching  both  the  empirical  psychological  support  and  the  efficacy  of  such 
concepts  in  decision  aiding. 
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1.  SUMMARY 


nils  paper  discusses  how  heuristics  can  be  incorporated  in  decision  aids 
used  for  structuring  decision  problems.  First,  we  describe  decision  theory 
in  terms  of  linked  subsystems;  this  permits  us  to  identify  the  sites  in  which 
it  is  necessary  to  employ  heuristic  rather  than  normative  algorithmic  proce¬ 
dures.  These  sites  lie  on  the  interface  between  decision-theoretic  subsystems 
and  the  decision  maker's  semantic  memory,  because  no  adequate  formal  specifica¬ 
tion  of  the  structure  of  semantic  memory  exists  as  yet,  and  consequently  no 
normative  procedures  for  accessing  information  from  semantic  memory  can  be 
specified.  Next,  we  make  use  of  production  systems  to  describe  heuristic  de¬ 
vices  handling  transactions  across  the  interface  between  the  decision- theoretic 
system  and  the  decision  maker's  semantic  memory  and  suggest  that  these  heuris¬ 
tics  can  be  incorporated  into  decision  aids  designed  to  ingprove  the  quality  of 
access  to  the  information  contained  within  the  decision  maker's  semantic  memory. 

We  identify  candidate  heuristics  for  use  in  development  of  such  decision 
aids.  We  develop  criteria  for  locating  the  operation  site  of  heuristics  re¬ 
ported  in  the  literature  and  then  select  those  heuristics  that  operate  on  the 
interface  with  semantic  memory.  These  heuristics  are  identified  within  a  com¬ 
prehensive  table  of  heuristics  cited  in  the  literature. 


2.  INTRODUCTION 


Interfacing  Machine-Client-Decision  Analyst t  What  Next? 

A  fundamental  problem  in  decision  analysis  is  the  extent  to  which  the 
decision  maker  should  work  directly  in  interaction  with  a  decision  analyst, 
or  instead,  interact  with  an  automated  decision  aid  in  building,  exploring, 
and  evaluating  a  decision-theoretic  model  of  the  problem  being  considered. 
Should  decision  aids  be  interfaced  directly  with  the  decision  maker,  or  should 
the  decision  analyst  serve  as  an  intermediary,  retaining  control  of  the  over¬ 
all  structuring  <;f  the  problem,  but  using  a  decision  aid  to  perform  the  more 
"automatic"  functions  (such  as  applying  a  multiattribute  utility  composition 
rule,  rolling  back  a  decision  tree,  and  so  on)?  Initially,  automated  aids 
were  designed  with  the  goal  of  "bootstrapping"  the  decision  maker  (Dawes  & 
Corrigan,  1974) .  Automating  a  decision  maker ' s  composition  rule  provided 
judgments  superior  to  his  or  her  unaided  intuitive  judgments,  subsequently, 
it  was  realised  that  structuring  and  decomposition  operations  might  also  be 
profitably  aided  (Selvidge,  1976).  Hun^hreys  (1978b)  found  that  it  was  the 
structuring  capability  of  a  bootstrapping  aid  that  was  valued,  particularly 
by  those  decision  makers  who  were  initially  unsure  about  their  preferences 
and  goals. 

However,  designing  a  decision  aid  with  structuring  capability  does  not 
involve  simply  an  extension  of  the  devices  employed  in  aids  designed  to  auto¬ 
mate  composition  rules.  As  we  show  in  section  3,  decision  theory  specifies 
completely  how  the  elements  of  a  decision  are  to  be  combined,  but  it  provides 
only  a  limited  set  of  rules  about  how  the  elerents  should  be  structured  (e.g., 
events  should  be  mutually  exclusive  md  exha'”  .ive) .  Thus,  heuristic  devices 


must  be  made  available  to  guide  structuring  activities.  These  heuristics  must 
operate  within  a  comprehensive  control  and  checking  framework  to  insure  that 
the  final  structure  is  valid  and  internally  consistent. 

The  research  program  reported  here  was  concerned  with  both  the  design  of 
a  structuring  aid  and  the  identification  of  heuristics  that  can  facilitate 
structuring  activity.  In  addition,  we  considered  new  approaches  to  structure 
problems  involving  uncertainty.  Specifically,  the  original  proposal  that  led 
to  this  work  called  for  the  following  tasks  to  be  carried  out: 

1.  Develop  interactive  Multiattribute  Utility  Theory  (MAUT)  aid  with 
dynamic  capability, 

2.  Collect  and  investigate  heuristics  useful  for  predecisional 
structuring,  and 

3.  Identify  and  program  useful  probability  assessment  procedures. 

Soon  after  we  started  this  work,  a  new  conceptualization  of  decision 
theory  began  to  emerge.  This  new  view  helped  us  to  see  where  decision  aids 
would  be  most  useful,  and  it  provided  criteria  for  judging  which  heuristic 
would  facilitate  structuring  activity  and  which  would  not;  this  view  will  be 
discussed  in  section  3.  Then,  in  section  4,  we  will  discuss  the  role  of  heu¬ 
ristics  and  present  a  list  of  heuristics,  derived  from  a  wide-ranging  examina¬ 
tion  of  the  literature,  along  with  evaluation  of  their  usefulness  for  struc¬ 
turing  .  Section  5  presents  Multiattribute  Utility  Decomposition  (MAUD) ,  the 
interactive  structuring  aid  whose  development  was  couple ted  under  this  project. 
Section  6  reports  on  work  in  developing  new  approaches  to  uncertainty  structur¬ 
ing.  In  section  7  we  will  conclude  with  an  overview  of  the  structuring  process 
and  sv  3St  uses  for  heuristic  devices  within  this  process . 


3.  THE  PROVINCE  OP  DECISION  THEORY 


Overview 

Our  view  of  decision  theory  is  that  it  consists  of  four  interlocking  sys¬ 
tems.  One  is  concerned  with  the  representation  of  utility,  another  with  the 
representation  of  uncertainty,  a  third  (the  core  system)  with  modeling  act- 
event  linkages,  and  the  last  with  the  influence  of  secondary  events  not  explic¬ 
itly  modeled  in  the  core  system.  Decision  theory  provides  for  the  coherent 
interfacing  of  these  systems,  so  that  an  output  from  one  system  across  an 
interface  completely  specifies  the  value  of  the  input  to  the  system  on  the 
other  side  of  the  interface.  For  example,  the  value  of  a  holistic  utility  of 
a  consequence  as  calculated  using  MAUT  can  be  used  in  expected  utility  calcula¬ 
tions  when  folding  back  an  act-event  tree. 

Although  decision  theory  prescribes  how  these  systems  should  link  together 
it  is  still  necessary  to  provide  inputs  from  outside;  in  this  sense,  decision 
analysis  is  not  a  closed  system.  This  is  always  the  case,  whether  decision 
analysis  is  viewed  as  an  engineering  science  or  as  a  clinical  art  (Buede,  1979) 
Models  of  the  environment  provide  inputs  in  the  engineering  science  approach. 


whereas  judgments  by  experts  are  the  main  inputs  in  clinical  art  applications. 
Subjective  judgments  necessarily  involve  semantic  memory  systems  (Anderson, 
1976) .  However,  the  province  of  decision  theory  (Lindley,  1974)  does  not  in¬ 
clude  models  of  semantic  memory  nor  of  the  environment. 

In  the  remainder  of  section  3  we  will  outline  briefly  the  historical 
development  of  decision  theory  into  the  four  interlocking  systems.  In  section 
4,  we  will  demonstrate  how  procedures  that  involve  passing  information  across 
an  interface  between  a  system  modeled  within  decision  theory  and  the  decision 
maker's  cognitive  information  processing  system  require  the  use  of  rules  spec¬ 
ifiable  only  as  heuristic  devices,  outside  the  axiomatic  formulation  of  deci¬ 
sion  theory. 


3.1  Historical  Development  of  Decision-Theoretic  Systems 

Decision  theory  has,  since  its  inception,  been  concerned  with  the  decompo¬ 
sition  of  immediate  acts  (Bernoulli,  1737) .*■  Acts  can  be  decomposed  into  the 
set  of  their  possible  consequences,  each  described  by  a  payoff  function  index¬ 
ing  the  value  gained  or  lost  through  the  realization  of  that  consequence. 

Given  the  assumption  that  the  decision  maker  will  choose  a  specific  subsequent 
act  in  each  eventuality  under  consideration,  the  decision  analysis  can  be  con¬ 
ducted  by  constructing  a  payoff  matrix.  Each  cell  in  this  matrix  defines  a 
particular  act-event  sequence,  the  consequence  of  which  is  represented  by  a 
payoff  shown  in  the  cell.  This  is  known  as  the  normal  form  of  decomposition 
of  immediate  acts  through  act-event  sequences. 

An  altnerative  decomposition  of  immediate  acts  through  act-event  sequences 
is  known  as  the  extensive  form,  usually  represented  as  a  decision  tree.  Here 
the  links  between  all  immediate  acts,  events,  subsequent  acts,  and  consequences 
under  consideration  are  linked  in  a  tree  structure  containing  act  nodes  and 
event  nodes.  The  left-hand  side  of  the  tree  starts  with  a  sinple  immediate 
act  node,  and  the  right-hand  side  ends  with  a  set  of  consequences.  The  set  of 
payoffs  associated  with  these  consequences  can  be  used  to  fill  the  cells  of  a 
payoff  matrix  identical  to  that  obtained  through  a  normal  form  decomposition 
of  the  same  problem.  The  difference,  however,  is  that  an  extensive  form  struc¬ 
turing  of  the  problem  allows  one  to  fold  back  the  decision  tree  piecemeal, 
examining  expected  utilities  at  intermediate  nodes  in  the  tree,  and  providing 
expected  utilities  for  immediate  acts. 

Hence,  we  can  see  that  normal  form  and  extensive  form?  decompositions  of 
a  set  of  immediate  acts  into  events,  subsequent  acts,  and  consequences  differ 
only  in  that  the  extensive  form  provides  the  decomposition  in  a  more  structured 
way,  allowing  an  analysis  of  the  problem  in  partially  decomposed  form,  as  well 
as  in  holistic  and  fully  deconposed  form.  Both  the  normal  and  extensive  forms 


^Bernoulli  was  concerned  with,  among  other  things,  the  question  why  people 
ever  answered  the  question,  "Should  I  buy  insurance  now?"  in  the  affirmative. 

2 

See  Luce  and  Raiffa  (1957,  chapter  3)  for  a  detailed  description  of  normal 
and  extensive  form  decomposition. 
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are  what  we  will  call  single-system  decompositions,  and  in  this  section  we 
shall  trace  the  history  of  decision  theory,  starting  with  these  single-system 
decompositions ,  up  to  its  present  state  of  development  in  which  decision  prob¬ 
lems  can  be  subjected  to  decompositions  by  four  separate  but  interlocked 
systems . 

At  the  outset  of  this  development,  about  20  years  ago,  initial  research 
emphasis  was  on  the  nature  of  the  optimal  composition  rule  for  use  within  the 
single  decomposition  system  in  prescribing  a  preference  function  over  the  set 
of  immediate  acts,  so  that  the  optimum  immediate  act  could  be  chosen  under  any 
circumstances  (barring  hindsight) .  Later,  as  a  consensus  began  to  develop 
around  the  advocacy  of  the  subjective  expected  utility  (SEU)  rules  as  the 
normatively  preferred  composition  rule  (Edwards,  Lindman,  &  Phillips,  1965; 

Lee,  1970),  the  emphasis  shifted  to  the  nature  of  the  optimal  structuring  of 
the  decision  problem  (e.g..  Brown,  1977)  in  conjunction  with  the  question. 

How  should  the  structure  adopted  be  extended  or  constrained  in  the  light  of 
difficulties  likely  to  be  encountered  in  interfacing  it  with  the  decision 
maker  and  the  environment? 

Figure  1  shows  the  interfaces  involved,  together  with  the  inputs  and 
outputs  crossing  these  interfaces. 

within  personalist  decision  theory,  the  decision-theoretic  model  is  not 
interfaced  directly  with  the  environment,  but  environmental  inputs  and  outputs 
are  mediated  through  the  decision  maker's  judgments.  This  process  involves 
the  invocation  of  semantic  memory  in  the  provision  of  "knowledge  of  the  world" 
(Anderson  &  Bower,  1974) .  This  point  has  often  been  missed,  sometimes  result¬ 
ing  in  the  construction  of  decision  analytic  models  proposed  for  interfacing 
directly  with  the  environment  (Howard,  1966) ,  despite  the  realization  that 
subjective  judgments  are  involved  right  down  the  line  (Stael  von  Holstein,  1977) . 

Decision  theory  does  not  in  itself  provide  any  model  of  semantic  inputs, 
or  of  the  environment,  so  in  each  case  inputs  cross  an  interface  from  a  system 
not  formally  modeled  to  one  that  is.  Hence,  the  total  system  cannot  be  closed, 
and  the  decision-theoretic  model  must  be  conceived  as  part  of  an  open  system 
in  which  elicitation  instructions  are  sent  as  outputs  across  the  interface  re¬ 
questing  the  necessary  information  to  proceed  with  modeling  the  decision 
problem. 

Three  different  types  of  information  are  required  for  input  with  the 
decision-theoretic  model: 

1.  Information  about  influences  of  acts  on  events,  and  vice  versa; 

2.  Information  about  probabilities  to  be  assigned  at  event  nodes;  and 

3.  Information  about  utilities  of  consequences. 

Because  the  system  on  the  other  side  of  the  interface  is  not  formally  modeled, 
no  axiomatic  way  of  specifying  the  form  of  the  output  (elicitation  instruction) 
will  guarantee  that  the  input  subsequently  received  is  that  required  at  that 
point  in  the  generation  of  the  decision-theoretic  system.  Hence  any  input 


oust,  if  possible,  be  checked  for  coherence  before  continuing  with  its  use  in 
modeling  the  problem.  The  lack  of  formal  criteria  for  identifying  valid  inputs 
into  decision-theoretic  models  explains  why  decision  analysts  have  been  unchar¬ 
acteristically  vague  in  specifying  elicitation  instructions  to  be  used  in  ob¬ 
taining  any  particular  input.  Decision  analysts  have  resorted  to  exhortations 
such  as,  "the  decision  analysts  should  take  on  a  role  not  too  dissimilar  to 
that  of  a  psychoanalyst"  (Brown,  Kahr,  fi  Peterson,  1974) . 


Despite  the  fact  that  optimal  elicitation  instructions  cannot  be  specified 
axiomatically,  some  forms  of  elicitation  instruction  will  be  more  efficient 
than  others.  In  subsequent  sections  of  this  report  we  will  develop  a  produc¬ 
tion  system  representation  of  heuristics  designed  to  optimize  such  efficiency. 
First,  though,  we  will  describe  revisions  and  extensions  of  the  decision- 
theoretic  system  shown  in  Figure  1  resulting  freon  research  enterprises  during 
the  past  two  decades,  that  were,  in  effect,  designed  to  push  back  the  interface 
between  act-event  linkage  system  and  the  decision  maker's  semantic  memory 
through  buffering  the  system  with  three  further  systems. 

In  the  original  representation  outlined  in  Figure  1,  input  information 
about  act-event  links  is  specified  in  terms  if  binary  (presence  or  absence) 
relationships;  input  information  about  probabilities  is  specified  in  terms  of 
(unidiraensional)  scalar  numbers  assignable  to  consequences  in  a  one-to-one  re¬ 
lationship.  Eliciting  these  various  inputs  in  applied  problems  has  not  always 
been  easy,  so  decision  analysts  have  developed  systems,  specified  axiomatically 
within  decision  theory,  designed  to  buffer  these  inputs.  The  general  specifica 
tion  of  each  of  these  three  buffer  systems  is  considered  below. 


Buffering  Act-Event  Linkages:  The  Influence  Diagram 

The  basic  decision-theoretic  model  of  Figure  1  assumes  that  the  decision 
maker  will  choose  a  specific  subsequent  act  in  each  eventuality  under  consider¬ 
ation.  This  assumption  implies  a  binary  linkage  between  events  and  subsequent 
acts:  A  specific  act  is  either  consequent  on  the  immediately  preceding  event 
in  the  decision  tree  structure,  or  it  is  not.  However,  in  attempting  to 
elicit  such  linkages,  decision  analysts  often  received  the  nonbinary  input, 

"it  depends."  Selvidge  (1975,  p.  46)  gives  an  example: 

Suppose  someone  were  to  ask  you  whether  or  not  you  will  buy  a  new  car 
next  year.  You  might  answer  that  it  depends  on  the  state  of  repair 
of  your  old  car.  At  the  present  you  do  not  know  what  the  outcome  of 
this  secondary^  event  "state  of  repair  of  your  old  car"  will  be  .... 

What  can  the  decision  analyst  do  about  this?  Selvidge  continues: 

. . .  but  you  can  list  the  different  outcomes  and  then  for  each  of  these 
assess  the  probabilities  that  you  would  or  would  not  buy  a  new  car 
under  those  circumstances. 


For  "secondary,"  read  "not  explicitly  modeled  within  the  act-event  tree." 


Selvidge  then  shows  how  such  information  can  be  structured  through  the 
use  of  an  influence  diagram,  modeling  an  act  (or  event)  whose  occurrence  is 
conditioned  by  a  number  of  secondary  events  and  defines  the  composition  rule 
appropriate  for  use  within  the  influence  diagram  structure. 4 

The  core  system  describes  linkages  between  acts  and  events  leading  to 
consequences.  Influence  diagrams,  in  effect,  act  as  a  buffer  for  this  core 
system,  enabling  the  modeling  of  secondary  events  that  influence  the  assess¬ 
ments  to  be  made  within  the  system. 


Buffering  Utility  Assessment:  Multiattribute  Utility  Theory 

When  the  value  of  a  consequence  can  be  completely  described  in  terms  of 
money  (e.g.,  worth  $1,000),  utility  assessment  may  be  reasonably  conceived  as 
mapping  a  unidimensional  utility  function  on  to  monetary  value.  The  scalar 
monetary  value  is  then  transformed  into  a  scalar  utility  value ,  which  is  input 
to  the  basic  decision- theoretic  model.  However,  many  consequences  possess 
moderately  or  extremely  complex  value  structures  (e.g.,  "have  a  child," 

Beach  et  al.,  1976).  Attempts  to  elicit  scalar  holistic  utility  assessments 
of  such  consequences  directly  from  decision  makers  are  usually  unsuccessful. 

The  decision  maker  typically  responds  to  the  elicitation  instruction  with  the 
reply  that  "there  are  too  many  factors  to  trade  off."  Early  attempts  to  solve 
this  problem  were  based  on  elaborating  the  act-event  tree  into  the  future,  look¬ 
ing  for  subsequent  consequences  that  would  possess  a  simpler  value  structure 
and  that  would  therefore  facilitate  direct  scalar  assessment  of  their  utilities. 
However,  there  is  no  guarantee  that  such  an  elaboration  will  uncover  consequences 
with  simpler  value  structure,  and  the  elaboration  has  the  additional  undesirable 
effect  of  pushing  the  decision  horizon  further  into  the  future,  a  future  that 
exists  only  as  a  fantasy  in  the  decision  maker's  mind  and  that  may,  at  the  time 
an  immediate  act  has  to  be  considered,  not  be  modelable  with  any  precision 
(Brown,  1978)  Humphreys,  1979) . 

An  alternative,  and  usually  more  efficient,  solution  is  to  stay  with  con¬ 
sequences  possessing  coup  lex  value  structures  in  the  act-event  tree  but  to 
buffer  the  inputs  representing  utility  assessments  of  these  consequences  using 
MAUT  to  provide  a  further  decomposition  of  their  value  structures  (Raiffa, 

1969)  von  Winterfeldt  S  Fischer,  1975)  Humphreys,  1977). 

The  structure  of  this  decomposition  may  be  modeled  in  either  normal  form 
or  extensive  form.  In  normal  form  decompositions,  the  structure  of  each  con¬ 
sequence  is  decomposed  into  part  worths  (Kneppreth,  Gustafson,  Leifer,  £ 

Johnson,  1974)  on  a  number  of  attribute  dimensions.  For  example,  the  conse¬ 
quence  of  building  a  particular  type  of  rapid  transit  system  may  be  decomposed 
into  travel  time,  user  comfort,  vehicle  construction  cost,  user  fatalities, 
level  of  environmental  noise,-  etc.  (Raiffa,  1969).  The  input  to  the  MAUT  sys¬ 
tem  is  vectors  of  part  worth  (decomposed  utility)  assessments  from  the  decision 
maker  (or  expert) ,  and  a  MAUT-axiomatized  composition  rule  is  applied  to  these 


For  a  specification  of  conputer-assisted  procedures  for  use  in  such  modeling 
see  Allen  et  al.,  1976. 


vectors  to  yield  the  holistic  utility  values  for  consequences  (Humphreys, 
1977) .  These  scalar  values  are  the  output  of  the  MAUT  system  and  the  input 
to  the  act-event  system  with  which  it  is  interfaced. 


In  extensive  form  decompositions,  a  utility  hierarchy  is  constructed, 
in  which  the  holistic  utility  of  each  consequence  is  decomposed  within  a  tree 
structure  (here  called  a  hierarchy) .  At  the  bottom  level  of  the  hierarchy  the 
decomposed  part  worth  assessments  are  input,  the  same  inputs  required  by  a 
normal  form  decomposition .  However,  the  composition  of  these  inputs  into 
holistic,  scalar  utilities  of  consequences  (emerging  at  the  top  of  the  hierar¬ 
chy)  is  performed  in  stages,  by  multiplying  through  the  hierarchy  (equivalent 
to  folding  back  a  decision  tree),  permitting  the  examination  of  partially  de¬ 
composed  utilities  of  consequences  in  addition  to  the  fully  decomposed  input 
assessments  and  holistic  utilities.  Examples  of  the  use  and  interpretation 
of  such  hierarchical  representations  of  the  utility  structure  of  consequences 
are  given  in  Beach,  Townes,  Campbell,  and  Keating  (1976);  Chinnis,  Kelly,  Mink- 
ler,  and  O'Connor  (1975);  and  Fischer,  Edwards,  and  Kelly  (1978).  In  addition, 
the  interactive  multi attribute  utility  decomposition  and  recomposition  decision 
aid,  MAUD,  computes  and  uses  a  hierarchical  utility  structure  to  aid  in  elicit¬ 
ing  weights  on  the  various  attribute  dimensions. 

All  of  these  systems  buffer  the  act-event  structure.  They  do  this  by 
moving  the  site  of  the  utility  interface  with  semantic  memory,  so  that  the 
relevant  elicitation  instructions  are  designed  to  elicit  inputs  representing 
decomposed  utilities  of  consequences  on  attribute  dimensions,  rather  than 
holistic  utilities. 


Buffering  Probability  Assessments  PIP  (Probabilistic  Information  Processing) 
Systems 

The  information  about  probabilities  to  be  assigned  to  event  nodes,  which 
is  required  as  input  to  the  act-event  system  shown  in  Figure  1,  is  of  the 
form  of  the  probability  of  a  hypothesis  given  particular  data:  P(h|d). 

The  hypothesis  (H)  is  that  the  future  event  represented  at  a  particular 
event  node  in  the  decision  tree  will  occur.  The  data  (D)  summarize  the  infor¬ 
mation,  not  shown  on  the  tree,  relevant  to  the  event  and  given  the  intervening 
scenario  represented  by  the  linkage  within  the  decision  tree  connecting  that 
event  to  the  present  situation  (immediate  act).  Edwards  (1962)  and  Pitz  (1975), 
among  many  others,  have  pointed  out  that  estimates  of  the  required  P(h|d)  are 
often  not  readily  available  and  have  to  be  constructed  by  integrating  P(d|h) 
over  a  variety  of  data  and  hypotheses.  For  example,  consider  the  hypothesized 
event,  "enemy  launches  attack."  One  must  estimate  P(h|d):  the  probability 
that  this  event  will  happen,  given  D,  the  state  of  affairs  at  that  future 
point  in  time  at  which  the  decision  maker  believes  the  hypothesized  event  may 
occur.  Faced  with  the  need  to  estimate  this,  the  decision  maker  usually  starts 
considering  data  defined  in  terms  of  P(d|h):  What  is  the  probability  associated 
with  particular  states  of  the  world  given  that  the  enemy  actually  launches  an 
attack?  With  a  complex  world,  a  large  number  of  P(d|h)s  exist;  hence  a  wide 
range  of  data  may  have  to  be  considered  and  integrated  in  the  attempt  to  obtain 
a  reasonably  well-defined  assessment  of  P(h|d). 


Pitz  (1975)  outlines  methods  by  which  a  person  may  do  this  within  the 
structure  of  his  or  her  own  semantic  memory.  For  an  appropriate  model  of 
semantic  memory,  Pitz  used  that  of  Anderson  and  Bower  (1973) ,  a  precursor 
of  systems  developed  by  Anderson  (1976),  which  are  discussed  in  Appendix  A. 

For  our  purposes  we  need  only  to  note  that  such  procedures  almost  invariably 
produce  suboptimal  results,  often  grossly  so,  when  compared  with  those  readily 
obtainable  through  the  use  of  Bayes1  theorem  to  perform  the  integration,  within 
what  Edwards  (1962)  called  a  Probabilistic  Information  Processing  (PIP)  system. 
Edwards'  definition  of  a  PIP  system  is  outlined  in  Figure  2. 

The  input  to  the  PIP  system  (elicitation  instruction)  across  the  inter¬ 
face  from  the  decision-making  system  is  a  request  for  information  about  the 
likelihood  of  an  event  (H?)  and  data  about  the  states  of  the  world  obtaining 
at  the  relevant  (future)  time,  D.  The  output  returned  across  this  interface 
is  P(h|d) ,  which  becomes  an  input  to  the  act-event  system.  In  order  to  obtain 
P(H|D) ,  the  PIP  system  requires  estimates  of  P(d[h)  over  all  Hs  and  Os  rele¬ 
vant  in  establishing  P(d|h).  These  are  elicited  either  from  decision  makers 
(or  experts)  or  from  formal  (computer-based)  models  of  the  environment  by  ask¬ 
ing  them  to  consider  the  probability  of  the  data  if  H  were  to  obtain.  Memory 
is  involved,  because  the  data  that  need  to  be  considered  are  almost  certainly 
not  those  impinging  at  the  present  moment  on  the  decision  maker's  senses,  or 
the  machinery  implementing  the  formal  model's  sensors,  but  have  to  be  recalled 
from  earlier  experience,  yielding  data  believed  to  be  relevant  in  establishing 
the  state  of  the  world,  D,  under  consideration. 

Hence,  use  of  a  PIP  system  serves  to  buffer  inputs  concerning  uncertainty 
about  future  states  of  the  world  to  the  act-event  system.  PIP  systems  were 
originally  proposed  as  labor-saving  devices  for  cases  where  P(h]d)  was  not 
directly  estimatable,  providing  Bayes'  theorem  as  an  automated  composition 
rule.  However,  the  superiority  of  Bayes'  theorem  over  intuitive  composition 
rules  for  integrating  P(d|h)s  to  obtain  P(h|d)  was  soon  confirmed  in  a  wi<?e 
variety  of  contexts  (Edwards  &  Phillips,  1964;  Edwards,  Phillips,  Hays,  & 
Goodman,  1968;  Howell,  1967;  Gustafson,  1969),  and  led  to  the  suggestion 
that  such  buffering  should  be  included  in  decision-aiding  systems  where 
possible  (Slovic  &  Lichtenstein,  1971) .  The  Bayesian  composition  rules  for 
use  in  PIP  systems  were  originally  formulated  for  normal  form  operation,  that 
is,  where  the  composition  of  the  input  information  into  P(h|d)  is  accomplished 
in  a  single  stage.  Extensive  form  representations  were  developed  later,  for 
use  where  the  composition  is  accomplished  through  intermediate  stages  within 
a  hierarchical  tree  structure  (Kelly  &  Barclay,  1973).  This  technique,  known 
as  cascaded  inference,  has  been  found  useful  in  situations  in  which  it  is 
possible  to  decompose  the  problem  of  estimating  P(h|d)  through  the  use  of 
intermediate  or  explanatory  variables,  i.e.,  where 

...  it  will  often  be  possible  to  assess  the  likelihood  of  the  data 
given  some  intermediate  variable,  and  the  likelihood  of  that  inter¬ 
mediate  variable  given  another,  and  so  on,  until  the  hypotheses  of 
interest  are  reached.  (Kelly  &  Barclay,  1973,  p.  388) 

Schum  and  Kelly  (1973)  have  also  developed  cascaded  inference  composition 
schemes  for  determining  the  inferential  impact  of  confusing  and  conflicting  re¬ 
ports  from  a  mixture  of  unreliable  sources,  where  these  reports  provide  data 
diagnostic  with  respect  to  a  particular  P(h|d)  under  consideration. 
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Interface  with  decision-making  system 


Figure  2.  PIP  system  inputs  and  outputs. 
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From  the  point  of  view  of  this  report,  all  such  systems,  whether  expressed 
in  extensive  or  normal  form,  extend  the  province  of  decision  theory  in  the  same 
way:  by  providing  a  subsystem  to  buffer  the  inputs  concerning  probabilities 
to  be  assigned  to  events  within  the  structure  of  the  core  act-event  system. 

3.2  Consecruences  of  Extending  the  Province  of  Decision  Theo 


The  developments  described  in  section  3.1  serve  effectively  to  extend  the 
province  of  decision  theory  by  buffering  all  three  interfaces  of  the  core  act- 
event  system  of  decision  theory  through  subsystems  involving  the  decomposition 
of  the  relevant  inputs .  The  inputs  of  the  subsystem  are  still  interfaced  with 
the  decision  maker's  semantic  memory,  just  as  were  originally  the  inputs  of 
the  stand-alone  act-event  system.5 6  However,  the  decomposed  information  now 
obtained  through  these  inputs  (part-worth  assessments,  P(d|h)  assessments,  and 
influence  relations  between  primary  and  secondary  events)  are  integrated  into 
the  relevant  utility,  probability,  and  event  inputs  to  the  core  system  by  com¬ 
position  rules  applied  within  the  subsystems.  Figure  3  summarizes  these 
relationships . 

The  province  of  decision  theory  has  thus  been  extended  to  include  four 
subsystems  within  the  total  system  bounded  by  the  hatched  line  shown  in  Figure 
3.  Each  subsystem  is  constructed  on  the  basis  of  decision- theoretic  axioms 
and  is  (or  should  be)  coherent  and  explicitly  specified  in  a  way  consistent 
with  these  axioms.  The  nature  of  transactions  between  each  subsystem  and  the 
core  act-event  system  is  also  completely  explicit,  because  the  effect  on  the 
relevant  input  to  the  core  system  of  modification  of  content  or  structure 
within  any  buffer  subsystem  is  completely  and  exhaustively  specifiable  on  the 
basis  of  the  relevant  decision-theoretic  axioms.  However,  this  specificity 
is  not  true  for  transactions  that  cross  the  interface  between  any  of  the  three 
subsystems  and  semantic  memory,  because  only  one  side  of  the  interface  is  ex¬ 
plicitly  modeled  within  decision  theory.  We  are  not  able  to  say  precisely 
what  effect  a  particular  modification  of  content  or  structure  within  semantic 
memory  will  have  on  the  resulting  input  from  memory  to  a  particular-  decision- 
theoretic  subsystem  (or  vice  versa) ,  because  any  precise  specification  of  a 
person's  semantic  memory  structure  is,  of  necessity,  missing.6  Nevertheless, 
while  there  is  no  axiomatic  way  of  specifying  transactions  across  the  interface 

5 

The  PIP  systems  were  also  proposed  for  direct  interfacing  to  formal  models  of 
the  environment,  as  shown  in  Figure  2.  Here  we  are  concerned  with  decision¬ 
making  situations  in  which  no  such  fully  structured  formal  model  of  the  environ¬ 
ment  is  available  a  priori,  and  in  which  the  structuring  task  facing  the  deci¬ 
sion  analyst  involves  what  Humphreys  (1979)  called  internal  ordering  and  reorder¬ 
ing  (as  opposed  to  external  ordering  through  the  use  of  a  formal  model) .  In  such 
cases  the  interface  of  the  decision-making  system  is  always  with  the  decision 
maker's  (or  expert's)  semantic  memory. 

6 

Formal  models  of  semantic  memory  (e.g.,  Anderson  &  Bower,  1973;  Kintsch,  1974; 
Norman,  Rummelhart,  &  CNR  Research  Group,  1975;  Anderson,  1976)  provide  precise 
specifications  of  systems  which  are  incomplete  and  fragmented  approximations  to 
semantic  memory  structure,  intended  for  investigative  purposes  only. 
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Figure  3.  Extended  province  of  decision  theory: 

core  system  buffered  by  three  subsystems. 
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with  semantic  memory,  this  paper  advances  the  thesis  in  subsequent  sections 
that  heuristic  devices  have  a  major  role  to  play  in  optimizing  such  trans¬ 
actions  to  meet  the  demands  of  the  decision-theoretic  system. 


4 .  HEURISTIC  DEVICES 


Overview 

Heuristic  devices  by  definition  are  suboptimal  when  compared  with  norma¬ 
tive  formulations  for  the  same  operations.  Working  within  a  normative  frame¬ 
work,  the  only  justification  for  the  use  of  heuristics  (and  resulting  risk  of 
inefficient  use  of  information  or  incoherence  of  the  material  generated)  is 
that  they  are  "quick  and  easy"  or  "reduce  information  processing  load”  and 
hence  generate  results  that  would  not  otherwise  be  available  because  the 
decision  maker  would  refuse  to  invest  the  amount  of  time  or  effort  involved 
in  following  a  normatively  acceptable  procedure.  In  this  report,  we  are  not 
interested  in  pursuing  such  a  line  of  justification; 7  rather,  we  are  concerned 
with  conditions  in  which  it  is  not  possible  to  specify  a  procedure  on  a  norma¬ 
tive  basis,  leaving  no  option  but  to  resort  to  a  heuristic  device.  Ibis  occurs 
only  in  situations  in  which  the  procedure  involves  crossing  an  interface  be¬ 
tween  a  system  that  is  explicitly  modeled  and  one  that  is  not.  The  only 
interfaces  that  meet  this  specification  in  Figure  3  are  the  three  between  the 
decision  theory  subsystems  and  memory. 

For  example,  one  of  these  interfaces  is  crossed  when  a  set  of  criteria 
is  elicited  from  the  decision  maker  for  purposes  of  assessing  the  utilities 
of  consequences  within  the  utility  buffering  system  shown  in  Figure  3.  Given 
that  it  is  not  possible  to  specify  the  procedure  to  be  used  here  in  normative 
terms,  what  happens  in  practice?  According  to  Humphreys  (1979), 

Practitioners  forced  to  think  about  the  problem  have  tended  to  draw 
on  analogies  with  problems  facing  psychoanalysts  and  clinical  psy¬ 
chologists.  Brown,  Kahr  and  Peterson  (1974)  suggested  that  the 
decision  analyst  take  on  a  role  "not  too  dissimilar  to  that  of  a 
psychoanalyst,"  although  such  a  suggestion,  taken  seriously  might 
involve  more  than  they  had  bargained  for  (c.f.,  Sandler,  Dare  fi 
Holder,  1973) .  Keeney  (1975)  described  a  MAU  decomposition  used  in 
studying  alternative  energy  policies  by  presenting  the  verbatim 
record  of  a  session  with  the  decision  maker  in  case  report  format. 
Humphreys  and  Humphreys  (1975)  suggested  the  use  of  elicitation  tech¬ 
niques  designed  for  use  within  repertory  grid  technique,  which  was 
originally  developed  at  Harvard  psychological  clinic  (Kelly,  1955) . 

None  of  these  techniques,  of  course,  are  grounded  in  any  axiomatic 
theory  of  preferences.  They  are  all  able  to  elicit  structural  mate¬ 
rial  that  would  not  have  been  volunteered  without  their  use,  and  it 

^For  an  example  of  a  comprehensive  attempt  of  such  justification  of  particular 
heuristic  procedures  enclosed  within  a  decision- theoretic  framework,  see 
Wallsten  (1978). 


is  possible  to  check  coherence  of  the  structures  so  generated. 

However,  there  is  no  guarantee  that  the  resulting  coherent  struc¬ 
tures  are  in  any  way  optimal. 

Humphreys  (1979)  discusses  the  need  for  internal  reorderings  of  prefer¬ 
ence  structures  generated  through  the  use  of  heuristic  techniques  to  bring 
them  closer  to  optimality  while  maintaining  coherence.  Section  5  describes 
the  structuring  (and  restructuring)  capability  of  the  computer  program  MAUD, 
whose  operation  is  controlled  through  the  operation  of  a  production  system. 
Section  4.1  provides  an  outline  introduction  to  the  notion  of  a  production 
system  and  the  potential  uses  of  such  systems  within  decision-theoretic 
contexts. 


4.1  A  Production  System  Representation 

Since  Emile  Post's  pioneering  work  (Post,  1943)  on  a  powerful,  new  symbol 
manipulation  system — which  he  called  a  production  system — several  authors  have 
developed  Post's  idea  as  a  basis  for  the  specification  of  psychological  models 
of  human  knowledge.8 

One  of  these  authors,  Newell  (1973),  explains  the  basic  operations  of 
production  systems  as  follows: 

A  production  system  is  a  scheme  for  specifying  an  information  process¬ 
ing  system.  It  consists  of  a  set  of  productions,  each  production  con¬ 
sisting  of  a  condition  and  an  action....  A  production  system,  starting 
with  an  initially  given  set  of  data  structures,  operates  as  follows. 

That  production  whose  condition  is  true  of  the  current  data  (assume 
there  is  only  one)  is  executed,  that  is,  the  action  is  taken.  Hie 
result  is  to  modify  the  current  data  structures.  This  leads  in  the 
next  instant  to  another  (possibly  the  same)  production  being  executed, 
leading  to  still  further  modification.  So  it  goes,  action  after  ac¬ 
tion  being  taken  to  carry  out  an  entire  program  of  processing,  each 
evoked  by  its  condition  becoming  true  of  the  momentarily  current 
collection  of  data  structures. 

Hie  advantage  of  production  system  representations  of  information  process¬ 
ing  systems  is  their  great  generality  and  flexibility.  As  Newell  and  Simon 
(1972,  p.  835-6)  report: 

Methods  are  to  be  represented  as  production  systems,  and  the  set  of 
all  methods  is  equivalent  to  the  set  of  all  production  systems  that 
will  realise  rational  courses  of  action  for  some  given  goals  and 
some  environment.  A  specific  problem  solver  has  available  some 
repertory  of  such  methods,  which  come  to  control  his  behaviour 
under  various  conditions. 


8 

For  a  general  review  of  the  use  of  production  systems,  see  Davis  and  King 
(1975)  . 


A  number  of  authors  have  taken  up  Newell  and  Simon's  suggestion  of  the 
application  of  production  systems  to  problem-solving  tasks  and  have  generated 
models  of  the  productions  implemented  within  a  person's  internal  judgmental 
or  semantic  memory  system.  The  best  articulated  model  is  that  of  Anderson 
(1976) ,  which  is  reviewed  in  Appendix  A.  However,  the  only  application 
within  a  decision-theoretic  context  is  that  of  Pits  (1979) ,  who  describes 
how  production  systems  can  be  used  to  generate  inferences  made  by  subjects 
through  testing  conditions  of  representativeness  (Tversky  &  Kahneman,  1974) . 

The  general  form  of  a  production  rule9  is 

R  :  {c+a} 

where  c  is  a  list  of  conditions  that  may  be  met,  and  a  is  a  list  of  actions 
to  be  taken  consequent  on  c  being  met.  In  generating  a  production  system, 

Pitz  was  primarily  interested  in  providing  an  account  of  how  his  subjects 
might  use  such  rules  in  ordering  and  noting  the  contents  of  their  semantic 
memories  to  arrive  at  inferences.  However,  in  this  paper  we  are  primarily 
interested  in  how  to  develop  such  systems  for  use  in  directing  and  controlling 
decision  aids  in  interaction  with  decision  makers. 

What  would  such  decision  aids  be  like?  They  would,  at  the  very  least, 
possess  the  following  features: 

1.  They  would  give  elicitation  instructions  to  activate  (but  not  con¬ 
trol)  the  decision  maker's  semantic  memory  and  to  elicit  specific 
outputs; 

2.  They  would  check  for  coherence  within  the  material  thus  output 
across  the  interface  to  a  decision-theoretic  subsystem  (explicitly 
modeled  in  the  decision  aid)  and  take  whatever  action  is  necessary 
should  such  checks  fail. 


4.2  A  Critique  of  Heuristics  as  Biases 

The  study  of  the  use  of  heuristics  within  decision-making  contexts  has 
traditionally  been  linked  with  the  study  of  bias  in  human  information  process¬ 
ing.  Attribution  of  bias  is  possible  only  in  situations  in  which  it  is  pos¬ 
sible  to  compute  what  an  unbiased  response  (inference)  might  be.  The  require¬ 
ments  for  such  situations  are  outlined  in  Figure  4.  The  degree  of  bias  is 
computed  by  comparing  the  output  of  the  intuitive  model  being  used  by  the  sub¬ 
ject  (person  suspected  of  being  biased)  with  the  output  of  a  formal  model 
axiomatically  grounded  within  decision  theory  (e.g.,  Bayes'  theorem)  when  both 
are  supplied  with  identical  input  data.  The  larger  the  difference,  the  greater 


9  In  section  4  we  use  the  notation  P  :  {C+a}  in  preference  to  R  :  {e*a}  to 
show  (i)  that  the  Rule  (R)  is  a  production  rule  (P)  and  that  C  and  A  are 
vectors. 


Precisely  specified  data  generating  process 
(i.e. ,  for  any  D,  P(D/H)  has  a  defined  value) 


Intuitive  Model 
used  by  subject 
(involving  the 
operation  of 
a  heuristic) 


Formal  Model 
(e.g.,  Bayes' 
theorem) 


P(H/D) 


P* (H/D) 


P* (H/D)  is  taken  as  the  criterion  value,  and  the  difference 
between  P(H/D)  and  P* (H/D)  forms  the  basis  for  the  measure  of  bias 


Figure  4.  General  form  of  the  setup  required  for  the  investigation  of 
bias  in  human  information  processing. 
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the  bias.  In  an  attempt  to  insure  that  the  input  to  the  two  models  is  identi¬ 
cal,  the  data-gene rating  process  has  to  be  precisely  specified.10 

The  intuitive  model  employed  by  the  subject  is  presumed  to  comprise  a  num¬ 
ber  of  heuristic  procedures,  and  the  degree  of  suboptimality  of  such  heuristics 
is  indexed  by  the  degree  of  computed  bias,  that  is,  the  degree  of  deviation 
from  the  optimal  results  prescribed  by  the  output  of  the  formal  model. 

Two  aspects  common  to  treatments  of  heuristics  as  biases  are  irrelevant 
to  the  issues  addressed  by  this  paper.  These  are 

1.  The  construction  of  a  precisely  specified  data-generating  process. 

We  are  interested  in  situations  in  which  much  of  the  data  has  to  be 
retrieved  from  the  decision  maker's  semantic  memory  (see  earlier 
section) ,  and  in  which  there  is  no  precise  external  specification  of 
the  structure  of  the  processes  involved  in  the  generation  of  such 
data. 

2.  The  comparison  with  a  formal  model  axiomatically  based  in  decision 
theory.  In  the  specification  and  implementation  of  decision  aids, 
we  assume  that  where  such  models  exist,  and  where  the  intuitive 
models  used  by  (unaided)  decision  makers  yield  output  that  is  sub- 
optimal  compared  with  that  provided  by  the  formal  model,  then  the 
decision  aid  will  implement  the  formal  model  in  preference  to  the 
intuitive  model,11  and  consequently,  the  resulting  judgment  will 
be  "unbiased." 

As  described  in  section  2,  what  we  are  interested  in  is  the  use  of  heu¬ 
ristics  at  sites  in  which  no  formal  model  can  be  axiomatically  specified,  and 
in  which,  therefore,  the  issue  of  suboptimality  cannot  be  investigated  by  a 
direct  test  against  a  formal  criterion.  We  will  have  to  address  the  question 
of  optimality  among  heuristics,  not  optimality  of  heuristics. 

However,  the  first  step  in  such  an  investigation  is  to  assemble  a  set  of 
heuristics  that  can  serve  as  candidates  in  our  investigation  of  problem  struc¬ 
turing  and  that  may  therefore  merit  incorporation  within  decision  aids.  The 
criterion  for  including  a  heuristic  in  this  set  is  that  it  must  be  sited  at 
the  interface  between  a  decision-theoretic  subsystem  and  semantic  memory  (see 
Figure  3) . 


A  typical  specification  is  as  follows:  "Chips  drawn  at  random,  with  replace¬ 
ment  from  two  bags,  each  containing  a  large  number  of  chips,  but  with  a  defined 
composition  of  chips,  such  as  70%  red  and  30%  blue,  or  30%  red  and  70%  blue  in 
each  bag";  see  Phillips  and  Edwards  (1966) . 

^This  rationale  for  decision  aids  is  called  "bootstrapping"  (Dawes  &  Corrigan, 
1974)}  see  also  Humphreys,  1977  (section  6.1),  and  Humphreys,  1979  (section  3). 


In  section  4.3  we  present  a  case  study  of  the  investigation  of  two 
processes  purported  to  underlie  the  reported  conservatism  bias  in  probabilis¬ 
tic  information  processing,^-2  mis aggregation  and  misperception.  The  case 
study  details  the  isolation  of  the  heuristics  involved  in  these  accounts  of 
bias  and  demonstrates  how  they  may  be  rejected  from  our  set  of  candidate  heu¬ 
ristics  because  they  are  not  sited  at  the  required  interface. 

In  the  literature,  consistent  deviations  from  the  output  of  an  appropri¬ 
ate  formal  model  are  often  attributed  to  a  global  causal  mechanism  such  as 
"availability"  or  "representativeness"  (Tversky  &  Kahneman,  1974) .  In  such 
cases,  we  found  that  a  reformulation  of  the  postulated  processes  using  a  pro¬ 
duction  system  representation,  like  that  discussed  in  section  4.1,  was  a 
necessary  step  in  isolating  the  actual  heuristic  procedures  involved  prior  to 
examining  their  site  of  operation. 

In  section  4.4  we  present  a  reformulation  of  Tversky  and  Kahneman' s 
account  of  representativeness  in  these  terms. 

Section  4.5  summarizes  the  results  of  our  formulations  of  the  existing 
literature  and  provides  a  classification  of  heuristics  along  the  following 
lines: 

1.  Effects  of  heuristics  upon  intuitive  judgments,  as  reported  in  the 
literature; 

2.  Explanation  suggested  by  the  authors  reporting  the  effect;  and 

3.  A  statement  of  which  of  these  explanations  of  heuristic  effects  we 
intend  to  investigate  further  for  use  within  decision-aiding  systems 
employing  structuring  heuristics,  and  our  reasons  for  doing  so. 

4.3  Heuristics  as  Biases,  A  Case  Study:  Conservatism, 


Misperception,  or  Misaggregation? 


Conservatism  in  intuitive  probabilistic  judgment  was  described  by  Slovic 
and  Lichtenstein  (1971)  as  follows: 

Upon  receipt  of  new  information,  subjects  revise  their  posterior 
probability  estimates  in  the  same  direction  as  the  optimal  model 
but  the  revision  is  typically  too  small:  subjects  act  as  if  the 
data  are  less  diagnostic  than  they  truly  are. 

These  conservative  responses  are  commonly  accounted  for  by  one  of  two  explana¬ 
tions:  as  the  result  of  either  intuitive  misperception  of  the  data  generator 
(Lichtenstein  &  Feeney,  1968;  Peterson,  DuCharme,  &  Edwards,  1968;  Pitz  &  Downing 
1967;  Wheeler  &  Beach,  1968;  Vlek  &  Beintema,  1967)  or  misaggregation  of  various 
pieces  of  information  to  produce  a  single  holistic  response  (DuCharme  &  Peterson, 
1967;  Peterson  &  Swensson,  1968;  Hammond,  Kelley,  Schneider,  &  Vancini,  1967). 


For  research  establishing  this  bias,  see,  for  example,  Peterson,  Schneider, 
and  Miller  (1965),  Phillips  and  Edwards  (1966),  and  Pitz  and  Downing  (1967). 


The  misperception  thesis  is  explained  by  Slovic  and  Lichtenstein  (1971) 
in  the  following  way: 

In  order  to  perform  optimally  subjects  must  have  some  understanding 
of  the  data  generator,  the  model,  device,  equation  or  assumptions 
used  by  the  experimenter  to  generate  the  stimuli  shown  to  the  subject. 

If  the  subject  misunderstands  the  data  generator  he  may  misperceive 
the  conditional  probability  of  the  data  given  the  hypothesis,  P(d|h). 

In  the  laboratory  experiments  commonly  used  to  support  the  misperception 
thesis,  the  true  nature  of  the  data  generator  (such  as  a  particular  type  of 
probability  distribution)  is  specifiable  precisely  because  the  experimenter 
generates  the  stimuli  shown  to  the  subject  from  well-specified  sources  such 
as  that  described  in  footnote  10.  In  real  world  contexts,  it  is  difficult  to 
specify  the  true  nature  of  the  data  generator,  because  in  such  real  world 
cases  it  is  notoriously  difficult,  if  not  impossible,  to  specify  a  veridical 
model  of  the  task  environment  with  which  intuitive  models  can  be  contrasted.  3 
Misperception  becomes  a  misnomer  when  veridical  perception  cannot  be  specified, 
but  the  explanation  may  still  be  of  interest  because  it  indicates  a  feature  of 
methods  used  to  model  stimuli  within  the  individual's  information  processing 
apparatus . 

But  where  is  this  feature  located  within  the  system  shown  in  Figure  1? 

It  is  neither  a  feature  of  the  assessment  of  content  within  decision  structure 
(although  it  may  lead  to  biased  judgments)  nor  of  a  structuring  heuristic  used 
to  access  information  from  semantic  memory  for  input  into  the  decision  struc¬ 
ture.  Rather,  it  is  a  feature  of  subjective  encoding  of  information  given  in 
the  environment  within  the  network  of  semantic  memory.  It  thus  operates  at 
the  interface  between  the  environment  and  semantic  memory,  and  not  at  the 
interface  between  semantic  memory  and  decision- theoretic  subsystems,  which  is 
of  concern  to  us  here.  Hence  we  can  reject  misperception  as  a  structuring 
heuristic  useful  within  our  terms,  because  it  is  not  situated  at  the  appropri¬ 
ate  interface  in  Figure  2. 

On  the  other  hand,  the  misaggregation  thesis  of  information  processing 
interprets  conservatism  as  the  result  of  intuitive  inadequacy  in  information 
aggregation  when  compared  to  the  procedures  for  aggregation  prescribed  by  the 
Bayesian  method.  On  this  explanation,  therefore,  conservatism  is  the  conse¬ 
quence  of  a  feature  of  intuitive  assessment  of  information  within  the  probabil¬ 
ity  buffering  subsystem  shown  in  Figure  3  and  is  thus  of  no  help  to  us  in 
specifying  ways  in  which  subjects  structure  the  decision  space  itself,  because 
once  again  it  is  not  situated  at  the  appropriate  interface. 

In  summary,  while  both  the  notions  of  misaggregation  and  misperception 
lead  to  the  specification  of  heuristics,  these  heuristics  did  not  meet  the 
criteria  for  inclusion  in  the  set  of  heuristics  that  might  be  useful  in  deci¬ 
sion  structuring  operations,  because  they  were  not  sited  at  the  appropriate 
interface.  The  next  section,  however,  describes  the  isolation  of  a  heuristic 
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See  quote  from  Newell  and  Simon  in  section  4.4  to  understand  why  this  is  so. 
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which,  although  conceived  within  an  account  of  bias  in  information  processing, 
is  located  at  the  appropriate  interface  and  has  already  been  reported  elsewhere 
in  use  as  a  decision-structuring  heuristic  (Sheppard,  1976;  Husg>hreys,  1979, 
section  5.2). 


4.4  Heuristics  Within  Production  Systems: 

Analysis  of  Representativeness 

This  section  presents  in  some  detail  a  production  system  representation 
of  one  heuristic,  described  by  Tversky  and  Kahneman  (1974) ,  which  we  believe 
is  a  component  in  intuitive  structuring  of  certain  kinds  of  decision  problems. 
Tversky  and  Kahneman  named  it  the  "representativeness"  heuristic.  We  delve 
fairly  deeply  into  the  modeling  of  this  example  to  give  a  detailed  demonstra¬ 
tion  of  a  production  system  representation  of  a  structuring  heuristic.  OTie 
subsequent  sections  of  this  paper  (and  our  work  emanating  from  it)  will  be 
centered  on  the  indications  of  structuring  heuristics,  rather  than  their  de¬ 
tailed  modeling.  First,  though,  we  detail  the  modeling  to  clarify  the  function 
of  structuring  heuristics  and  to  show  the  advantages  of  their  specification  as 
production  systems. 

The  effects  accredited  to  the  use  of  the  representativeness  heuristic 
have  been  shown  to  bias  intuitive  judgment  considerably  and  to  be  highly 
replicable.  Tversky  and  Kahneman  (1974,  p.  1124)  have  introduced  it  as  follows: 

Many  of  the  probabilistic  questions  with  which  people  are  concerned 
belong  to  one  of  the  following  types:  What  is  the  probability  that 
object  A  belongs  to  class  B?  What  is  the  probability  that  event  A 
originates  from  class  B?  What  is  the  probability  that  process  B 
will  generate  event  A? 

In  answering  such  questions,  people  typically  rely  on  the  representa¬ 
tiveness  heuristic,  in  which  probabilities  are  evaluated  by  the  degree 
to  which  A  is  representative  of  B,  that  is  by  the  degree  to  which  A 
resembles  B.  For  example,  when  A  is  highly  representative  of  B,  the 
probability  that  A  originates  from  B  is  judged  to  be  high.  On  the 
other  hand  if  A  is  not  similar  to  B,  the  probability  that  A  originates 
from  B  is  low. 

A  consequence  of  evaluation  by  representativeness  is  that  "if  people 
evaluate  probability  by  representativeness,  therefore,  prior  probabilities 
will  be  neglected"  (Tversky  &  Kahneman,  1974,  p.  1124) .  Tversky  and  Kahneman 
have  tested  this  effect  in  a  variety  of  experiments,  one  of  which  is  examined 
here  in  detail.  In  this  experiment  subjects  were  asked  to  judge  the  likelihood 
that  an  individual,  call  him  Dick,  is  either  a  lawyer  or  an  engineer.  Subjects 
were  given  two  sets  of  data  from  which  to  make  their  judgment:  ■ 

1.  Base-rate  data:  lawyers  and  engineers  are  in  a  ratio  of  7:3  in 
the  population  in  question. 

2.  Case  data:  a  brief  personality  sketch  so  that  the  subject  may 
perceive  a  similarity  between  Dick's  described  traits  and  the 
stereotype  of  a  lawyer  or  engineer. 
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From  the  results,  a  consistent  pattern  emerged  of  subjects  placing  much 
greater  evidential  weight  on  the  case  data  than  on  base-rate  data.  Judgments 
were  typically  resistant  to  changes  in  the  ratio  of  lawyers  to  engineers  in 
the  population,  and  subjects  typically  ignored  base-rate  data  even  when  the 
case  data  description  was  modified  so  as  to  become  totally  uninformative. 

The  explanation  offered  for  this  judgment  bias  by  Tversky  and  Kahneman 
(1974,  p.  1125)  is  that  "subjects  evaluated  the  likelihood  that  a  particular 
description  belonged  to  an  engineer  rather  than  to  a  lawyer  by  the  degree  to 
which  this  description  was  representative  of  the  two  stereotypes,  with  little 
or  no  regard  for  the  prior  probabilities  of  the  categories." 

This  explanation  can  be  placed  in  context  through  the  use  of  a  model  of 
sequential  processes  involved  in  probabilistic  inference  first  presented  in 
Phillips  and  Wright  (1977).  This  model  is  reproduced  as  Figure  5.  According 
to  the  Phillips  and  Wright  model,  the  use  of  probabilistic  information  in  a 
judgmental  task  requires  a  considerable  elaboration  of  the  problem  over  a 
simple  deterministic  assessment  and  involves  the  prior  rejection  of  two  other 
possible  response  modes  as  inappropriate:  a  response  under  certainty  at 
stage  1  of  the  scheme  shown  in  Figure  5,  and  a  response  consequent  on  a  re¬ 
fusal  to  assess  probabilistic  evidence  in  spite  of  uncertainty  at  stage  2. 

Because  subjects  in  the  Tversky  and  Kahneman  experiments  were  presented 
with  data  inviting  probabilistic  inferences  and  were  prepared,  quite  happily, 
to  produce  probabilistic  responses,  these  subjects  apparently  elaborated  the 
problem  sufficiently  to  arrive  at  stage  3  of  the  Phillips  and  Wright  schema. 
The  biases  typically  found  in  the  inferences  made  are  thus  the  consequence 
of  the  particular  way  in  which  judges  elaborate  the  structure  of  the  problem 
at  stage  3  in  the  schema.  The  judgmental  problem  is,  in  fact,  modeled  in  a 
fashion  that  leads  judges  to  be  selective  about  which  of  the  available  proba¬ 
bilistic  information  they  incorporate  in  the  structure  they  use  as  a  basis 
for  their  inferences. 

Tversky  and  Kahneman' s  results  indicate  that  subjects  r/iven  case  data 
perceived  as  being  similar  to  (or  representative  of)  a  stereotyped  class,  at 
block  2  in  Figure  6,  typically  made  their  judgment  on  the  basis  of  the  degree- 
of-fit  between  the  case  data  and  the  characteristics  of  the  stereotypes,  ne¬ 
glecting  base-rate  data.  Such  judgments  based  on  representativeness  are  repre¬ 
sented  in  Figure  6  as  those  routes  through  the  diagram  marked  by  double  lines. 
Thus  the  representativeness  heuristic  is  characterized  by  two  features: 

1.  Using  a  particular  search  instruction  within  semantic  memory  ("fit 
these  data  to  the  characteristics  of  a  known  class") ,  and 

2.  Making  a  probabilistic  judgment  on  the  basis  of  the  degree  of  this 
fit  without  reference  to  any  other  available  data. 

It  is  the  latter  of  these  alone  that  violates  the  axiomatic  model  in  fail¬ 
ing  to  combine  prior  and  posterior  probabilities.  Adherence  to  the  axiomatic 
model  would  involve  redrawing  Figure  6  so  that  it  became  possible  for  a  judge 
to  move  through  both  steps  2  and  3.  In  fact,  judges  given  useful  case  data 
typically  take  the  route  passing  through  steps  1,  2,  and  6  and  so  on  (as  a 
result  of  the  representativeness  heuristic) .  Judges  given  worthless  case  data 
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Question 


Motes. 
Stage  1 

Stage  2 

Stage  3 


.  Judge's  decision  here  is  decided  by  a  variety  of  factors  classified 
under  (a)  cultured,  variables,  (b)  psychological  variables,  and 
(c)  task  variables. 

.  Judge's  decision  here  is  also  decided  by  factors  classified  under 
cultural  variables  and  psychological  variables  (expecially  those 
relating  to  open/closed  mindedness;  see  Rokeach,  1960). 

.  Ohis  further  decomposition  of  the  basis  for  the  inference  involves 
the  subjective  elaboration  of  the  structures  represented  in  event 
and/or  probability  buffer  systems  shown  in  Figure  3. 


Figure  5.  Model  of  the  cognitive  processes  involved  in 

inference  (developed  from  Wright  &  Phillips,  1977) . 
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(data  that  permit  little  or  no  association  with  any  already  encoded  class  con¬ 
cept)  persist  in  neglecting  base-rate  data  and  choose  to  take  the  route  through 
steps  1,  2,  and  4.  Only  subjects  given  no  case  data  take  account  of  frequencies, 
and  they  travel  routes  1,  3,  and  5. 

It  thus  can  be  seen  that  judgments  using  case  data  and  those  using  base- 
rate  data  involve  traversing  entirely  different  routes  through  the  block  dia¬ 
gram.  A  judgmental  procedure  involving  the  combination  of  case  and  base-rate 
data  would  require  a  different  system  from  that  of  Figure  6,  one  that  would 
open  up  routes  to  a  problem  solution  quite  different  from  those  described 
previously . 


We  are  now  in  a  position  to  reformulate  the  problem  of  the  representative¬ 
ness  effect  and  its  etiology  into  the  question.  Why  are  judgments  such  as  that 
described  above  typically  structured  through  the  sequential  procedures  of  the 
form  shown  in  Figure  6  rather  than  in  a  form  permitting  the  combination  of 
base-rate  and  case  data?  The  following  reformulation  of  the  representativeness 
heuristic  in  production  system  terms  suggests  a  solution  to  this  question. 

Applying  the  R  s  C  -*•  A  formulation  of  a  production  system  described  in  out¬ 
line  in  section  4.1  (and  in  detail  in  Appendix  A)  to  the  structuring  principles 
underlying  Figure  6,  we  obtain: 


Condition 


Action 


Active  memory  contains  a 
class  of  objects  that  match 
this  object  or  event. 


Set  the  probability  of  this 
object  or  event  being  a  mem¬ 
ber  of  the  class  in  question 
to  match  the  degree  of  fit 
between  it  and  the  matching 
class . 
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The  implementation  of  this  production  leads  the  judge  down  routes  1,  2,  and  6 
and  so  on,  in  Figure  6,  and  thus  entails  the  neglect  of  base-rate  data  and 
reliably  reproduces  the  reported  biases  in  responses  (Tversky  &  Kahneman,  1974) . 
In  addition,  the  way  in  which  memory  is  accessed  in  this  production  indicates 
that  the  site  of  the  operation  of  the  heuristic  is  the  interface  between  memory 
and  the  probability  buffering  subsystem  shown  in  Figure  3. 
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There  is,  however,  a  great  deal  more  to  the  full  specification  of  a  pro¬ 
duction  system  than  merely  suggesting  one  possible  production  that  such  a  sys¬ 
tem  might  contain.  In  particular,  it  is  necessary  for  our  purposes  to  under¬ 
stand  the  process  whereby  some  productions  pass  a  selection  test  and  thus  be¬ 
come  potentially  invokable,  whereas  others  fail. 

According  to  Anderson  (1976,  p.  186)  production  selection  consists  of 
"quick  partial  tests  ...  to  see  if  the  condition  of  a  production  is  relevant 
to  the  current  contents  of  active  memory."  A  production  can  be  implemented 
only  if  it  is  appropriate  to  the  contents  of  active  memory,  and  thus  production 
selection  is  crucially  dependent  on  the  current  activation  of  memory. 
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He  have  so  far  shown  only  that  if  a  particular  production  is  implemented, 
then  all  the  judgmental  effects  associated  with  representativeness  will  follow. 
It  remains  to  be  shown  why  this  production  is  so  commonly  invoked.  Tversky  and 
Kahneman's  work  on  representativeness  contains  no  clues  as  to  the  determinants 
of  its  invocation.  However,  the  crucial  dependence  of  production  selection 
upon  the  currently  active  memory  indicates  that  the  answer  lies  in  discovering 
the  determinants  of  the  particular  activation  of  memory.  Newell  and  Simon 
(1972,  p.  849)  provide  a  clue  to  the  answer: 

We  can  know  the  objective  task — "out  there" — only  through  its  partic¬ 
ular  representations.  There  is  no  neutral  way  of  describing  the  task 
environment.  As  a  consequence,  task  instructions  do  much  more  than 
define  the  task;  they  provide,  in  addition,  a  specific  representation 
of  it  that  can  serve  to  define  an  initial  problem  space,  and  even 
parts  of  an  initial  problem  solving  program  for  the  subject. 

Thus,  the  repercussions  of  the  subject's  heuristic  structuring  of  the 
task  environment  are  felt  throughout  the  entire  judgmental  process.  One  such 
repercussion,  we  suggest,  is  on  the  configuration  of  activated  memory. 

This  accords  neatly  with  our  finding  in  the  representativeness  case.  The 
process  traced  in  Figure  6  was  found  to  be  the  result  of  invoking  the  repre¬ 
sentativeness  production.  Any  search  to  discover  the  basis  for  the  invocation 
of  that  production  leads  back  through  the  process  of  selection  of  potentially 
appropriate  productions,  and  of  memory  activation,  to  the  issue  of  the  subject' 
heuristic  structuring  of  the  task  environment.  The  whole  process,  from  initial 
structuring  to  judgmental  response,  represents  a  highly  constrained  system, 
each  stage  of  which  is  partially  determined  by  prior  stages. 

What  form  of  heuristic  structuring  precedes  and  determines  a  judgment 
by  representativeness?  While  Tversky  and  Kahneman  do  not  directly  address 
the  structuring  issue,  they  have  recently  (1977)  suggested  a  link  between 
representativeness  and  the  intuitive  introduction  of  causal  thinking  into  the 
judgmental  process.  This  suggestion  is,  in  effect,  extended  here  to  show  how 
a  subject's  intuitive  modeling  of  the  task  environment  in  causal  terms  deter¬ 
mines  which  productions  pass  the  selection  test  and  consequently  are  available 
to  be  invoked.  Which  portions  of  memory  a  subject  activates  and  in  what  form 
(in  full,  extended  propositional  form  or  in  the  more  limited  form  required  for 
matching-by-intersection  tests)  are  determined  by  the  subject's  initial  struc¬ 
turing  of  the  task  environment.  Introducing  a  causal  model  of  the  task  environ 
ment  is  one  form  of  such  initial  structuring,  and  such  a  model  can  function  as 
the  initial  memory  activator.  Abelson's  (1976)  work  on  cognitive  scripts  sup¬ 
ports  the  belief  in  the  predominance  of  this  structuring  of  judgmental  problems 
in  causal  terms. 

Thus,  in  the  example  displayed  in  Figure  6,  subjects'  judgments  of  the 
probability  of  Dick  being  a  lawyer  typically  involve  the  initial  generation  of 
a  hypothesis  concerning  a  causal  relation  between  Dick's  character  traits  and 
intentions  on  the  one  hand  (derived  from  the  personality  sketch  given)  and 
Dick's  choice  of  profession  on  the  other,  and  this  hypothesis  creates  an 
active  partition  of  memory.  It  is  assumed  that  the  portion  of  memory  likely 
to  be  activated  in  these  circumstances,  and  hence  available  for  accessing, 
consists  of  a  simple  pattern  specifying  traits  and  properties  typical  of 
"lawyer."  The  subject's  judgmental  task  is  now  restricted  to  merely  scanning 


for  a  match  between  Dick's  character  traits  derived  from  the  given  personality 
sketch  and  the  properties  associated  with  "lawyer"  thus  activated  in  memory. 

Hence,  the  production  typically  inplemented  not  only  neglects  base  rates 
but  engenders  a  fairly  loose  and  imprecise  assessment  of  case  data.  A  more 
precise  assessment  of  case  data  would  require  a  propositional  representation 
of  relevant  memory  and  a  closer  screening  of  the  probe  (that  is,  the  character 
sketch  of  Dick)  to  make  an  exact  assessment  of  the  information  it  contains 
(for  instance,  encoding  all  the  verbal  elements  in  the  proposition,  as  opposed 
to  merely  scanning  for  property  words  to  be  matched  with  properties  encoded  in 
memory) .  In  short,  the  specific  activation  of  memory  involved  in  structuring 
the  problem  according  to  a  causal  model  determines  what  information  is  acces¬ 
sible;  this  in  turn  determines  what  judgmental  procedure  is  used  to  generate 
a  probabilistic  response.  Methods  based  on  Bayes'  theorem  provide  a  formal, 
optimal  procedure  for  the  combination  of  information  in  inference  but  are  of 
necessity  silent  on  how  such  information  is  accessed.  However,  in  intuitive 
judgment,  restrictions  of  access  to  information  within  memory  (due  to  restricted 
active  memory)  can  place  crucial  restraints  on  the  inferential  procedures  that 
cam  be  brought  to  bear.  If  a  certain  memory  activation  does  not  meet  the  con¬ 
dition  of  a  production,  that  production  is  rendered  inoperable. 

The  implication  for  decision  analysis  of  the  above  interpretation  of  the 
representativeness  heuristic  is  that  the  method  of  accessing  information  for 
input  into  the  decision  structure  can  prevent  its  optimal  use  in  accordance 
with  Bayes'  theorem.  If  an  inadequate  or  inappropriate  structuring  heuristic 
is  employed  at  the  interface  between  memory  and  the  decision-making  structure, 
the  decision  maker  runs  the  risk  of  placing  a  structure  on  the  decision 
problem  that  will  of  necessity  commit  him  to  inappropriate  and  nonoptimal  in¬ 
ferences  and  actions,  regardless  of  the  optimality  of  the  composition  rules 
(Bayes*  theorem,  SEU,  etc.),  which  he  uses  to  manipulate  information  within 
the  structure  in  arriving  at  his  inference  or  plan  of  action. H 

Incidentally,  it  is  worth  noting  that  judgment  by  representativeness 
counters  prima  facie  the  supposed  ubiquity  of  simplification  techniques 
designed  to  ease  cognitive  strain  (Miller,  1956;  Newell  fi  Simon,  1972)  in 
intuitive  decision  making.  Since  case  data,  unlike  base-rate  data,  must  be 
matched  against  information  retrieved  from  memory  to  be  put  to  use  in  the 
judgmental  process,  the  diminution  of  cognitive  strain  thesis  would  find  it 
surprising  that  base-rate  data  rather  than  case  data  are  typically  neglected. 

The  former,  it  may  seem,  are  more  easily  put  to  use,  requiring  less  cognitive 
work  on  the  part  of  the  judge.  The  material  just  presented  therefore  suggests 
that  it  is  misguided  to  explain  the  use  of  the  representativeness  heuristic  in 
inferences  as  resulting  from  the  need  to  reduce  information  processing  load. 
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Sheppard  (1976)  and  Humphreys  (1979,  section  5.2)  present  a  case  study  of 
the  use  of  such  a  heuristic  by  a  division  manager  of  a  medium-large  U.K. -based 
firm  in  making  foreign  location  decisions  and  discuss  the  advantages  and 
limitations  of  such  an  approach. 


4.5  Classification  of  Heuristics 


Table  1  summarizes  and  classifies  the  results  of  published  investigations 
into  the  use  of  heuristics  in  intuitive  judgment.  Column  1  of  the  table 
specifies  the  features  which,  it  is  believed,  are  characteristic  of  intuitive 
judgment.  Column  2  lists  the  explanations  given  for  the  presence  of  these 
features  referenced  by  the  authors  supporting  these  explanations.  In  columns 
1  and  2  we  have  used  the  currently  prevalent  nomenclature  for  the  phenomena  in 
question.  In  column  3,  however,  we  have  broken  down  this  existing  work  on 
heuristics  into  two  classes:  those  that  may  be  relevant  to  the  elicitation 
of  structuring  heuristics  as  we  have  defined  the  terms,  and  those  that  we  be¬ 
lieve  are  not  relevant.  We  briefly  state  the  basis  for  doing  so  in  each  case. 


5.  AH  APPLICATION 


Overview  of  MAUD 

MAUD,  Multiattribute  Utility  Decomposition,  is  an  interactive,  computer- 
based  decision  aid  designed  to  help  decision  makers  faced  with  a  choice  among 
alternatives  where  the  basis  for  preference  lies  in  differences  in  worth  on  a 
number  of  different  attributes  possessed  in  varying  degrees  by  those  alterna¬ 
tives.  MAUD  assists  and  guides  the  decision  maker  in  (a)  structuring  and  de¬ 
composition  of  such  preferences  in  a  multiattributed  form  and  (b)  finding  out 
the  tradeoffs  he  or  she  is  prepared  to  make  between  values  on  the  various  at¬ 
tributes  in  recomposing  these  decomposed  preferences  into  holistic  utilities 
to  be  placed  on  the  alternatives  as  a  basis  for  choice.  An  embryonic  version 
of  MAUD  was  described  by  Humphreys  and  Humphreys  (1975) ,  and  subsequent  versions 
have  been  found  to  be  of  use  in  situations  in  which  the  decision  maker  has  some 
intuitions  about  relevant  aspects  of  the  decision  problem  but  has  not,  as  yet, 
been  able  to  discover  its  precise  subjective  worth  structure. 

MAUD  was  designed  to  work  in  direct  interaction  with  the  decision  maker, 
without  a  decision  analyst,  counselor,  or  other  expert  as  intermediary.  How¬ 
ever,  since  MAUD  is  limited  to  the  examination  of  value  tradeoffs  among  mem¬ 
bers  of  a  homogeneous  set  of  alternatives,  a  decision  analyst  or  counselor  in 
discussing  a  complex  problem  facing  the  decision  maker  should  first  arrive  at 
an  agreed  definition  of  the  set  of  alternatives  whose  worth  structure  MAUD  is 
to  investigate  and  the  goal  under  which  this  worth  structure  is  subsumed. 


5.1  Example  of  the  Use  of  a  Heuristic  Device: 

Use  of  Structuring  Heuristics  in  the 
Elicitation  of  Poles  of  Attribute  Dimensions 

Decision  theory  is  of  necessity  silent  concerning  the  elicitation  of  at¬ 
tribute  dimensions  for  incorporation  in  a  decomposed  preference  structure. 
However,  methods  for  eliciting  such  dimensions  have  been  studied  in  some  de¬ 
tail  within  research  in  the  field  of  personality,  stemming  from  the  discussion 
by  Kelly  (1955)  of  the  repertory  grid,  a  device  for  conceptualizing  an  individ¬ 
ual's  dimensional  cognitive  structure.  The  rating  form  version  of  the  reper¬ 
tory  grid  (see  Bannister  &  Mair,  1968)  is  closely  related  structurally  to  the 
normal  form  decomposition  of  utilities  of  terminal  events  (called  elements 
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within  repertory  grid  terminology)  into  vectors  of  part-worth  ratings  on  a 
set  of  attribute  dimensions  within  a  preference  structure <j^e  two  prin¬ 
cipal  heuristics  discussed  by  Kelly  (1955)  for  elicitation  of  attribute  dimen¬ 
sion  .poles  are  known  as  the  Difference  Method  (DM)  and  the  Opposite  Method  (OM) . 
They  are  reviewed  in  Bannister  and  Mair  (1968) ;  Adams -Webber  (1970) ;  and 
Epting ,  Suchman,  and  Nickeson  (1971) .  Both  these  methods  are  used  in  MAUD, 
an  interactive  computer  program  for  the  structuring,  decomposition,  and  recom¬ 
position  of  preferences  between  multiattributed  alternatives  (Humphreys  & 
Wisudha,  1979) .  When  the  decision  maker  has  reached  the  point  in  structuring 
his.  or  her  decision  problem  at  which  at  least  three  alternative  terminal  events 
are  under  consideration,  and  tradeoffs  have  to  be  made  in  determining  relevant 
preference  between  these  terminal  events,  MAUD  may  be  used  as  an  interactive 
aid  in  developing  the  preference  structure  among  these  alternatives.  MAUD 
starts  by  using  the  Difference  Method  and  a  heuristic  device  to  elicit  an  at¬ 
tribute  dimension.  Figure  7  reproduces  the  relevant  portion  of  a  printout 
from  a  typical  MAUD  interaction,  together  with  comments  on  the  functions  of 
the  various  instructions  used  in  achieving  this  elicitation. 

The  material  elicited  through  the  use  of  this  heuristic  are  two  words 
(or  phrases)  that  are  assumed  to  define  the  poles  of  an  attribute  dimension 
scaled  in  terms  of  a  monotonic  part-worth  preference  function,  so  that  ratings 
of  the  alternatives  under  consideration  bv  the  decision  maker  on  this  dimen¬ 
sion  will  index  the  degree  of  part-worth*-'  of  each  alternative  in  terms  of 
the  degree  to  which  they  possess  the  relevant  attribute. 

Since  the  processes  involved  in  the  decision  maker's  semantic  memory  in 
forming  the  output  shown  in  Figure  7  are  not  explicitly  modeled,  we  cannot  be 
sure  that  the  elicited  words  have  the  required  characteristics,  as  just  out¬ 
lined.  However,  we  can  perform  a  number  of  checks  to  test  whether  the  neces¬ 
sary  assumptions  are  met  by  the  elicited  words.  These  have  been  reviewed  by 
Hunphreys  (1978a)  as  range  of  convenience  (after  Kelly,  1955) ,  which  estab¬ 
lishes  the  possibility  of  actually  making  tradeoffs  involving  each  and  every 
alternative's  rating  on  the  attribute  dimension;  bipolarity,  which  requires 
that  the  poles  be  mutually  exclusive  and  cumulatively  exhaustive  to  insure  an 
unambiguous  unidimensional  scale  between  the  poles;  and  monotonicity,  which 
insures  that  increasing  numerical  scale  values  index  increasing  preference. 

1"* These  dimensions  are  called  constructs  within  repertory  grid  terminology. 
However,  the  repertory  grid  decomposition  does  not  represent  a  preference 
structure,  because  the  ratings  on  constructs  are  J-scaled  (linear  between 
poles  as  defined,  with  no  consideration  of  the  position  ideal  point  or  the 
dimension)  rather  than  I-scaled  (part-worth,  preference  ratings).  Coombs  (1964), 
Humphreys  (1977,  section  4),  and  Humphreys  and  Wisudha  (1979,  section  3.5.1) 
discuss  in  detail  the  folding  relationship  between  J-scaled  and  I-scaled  rat¬ 
ings  on  an  attribute  dimension. 

16 

MAUD  uses  the  Opposite  Method  in  preference  to  the  Difference  Method  when 
more  them  two  attribute  dimensions  are  already  present  in  the  preference 
structure.  However,  should  the  Opposite  Method  fail  to  elicit  appropriate 
poles,  MAUD  will  then  (temporarily)  revert  to  use  of  the  Difference  Method. 

17 

For  a  discussion  of  part-worth,  see  Kneppreth  et  al.  (1974) . 
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Figure  7.  Interaction  between  decision  maker  and  MAUD  using 

the  Difference  Method  to  elicit  poles  of  an  attribute 
dimension. 


If  any  of  the  checks  of  these  assumptions  fails,  then  the  numbers  assigned 
to  alternatives  on  the  offending  attribute  dimension  will  of  necessity  be  inco¬ 
herent  within  the  utility  buffer  system  shown  in  Figure  3  (and  within  any  of 
the  other  decision-theoretic  subsystems  with  which  it  is  interfaced) .  To  re¬ 
store  coherence,  restructuring  activity  is  required.  Humphreys  (1979)  describes 
techniques  designed  to  accomplish  this  as  reordering  techniques,  as  distinct 
from  ordering  techniques  used  to  elicit  initial  (unchecked)  conponents  of  the 
structure,  similar  to  the  Difference  Method  and  Opposite  Method  outlined  earlier. 

Reordering  techniques,  like  ordering  techniques,  involve  crossing  the 
interface  with  semantic  memory  and  therefore  involve  heuristic  devices.  How¬ 
ever,  the  various  heuristics  employed  do  not  stand  in  isolation  or  in  competi¬ 
tion  with  one  another;  they  can  be  conceived  as  integral  parts  of  an  ordering 
and  reordering  system  that  invokes  heuristics  as  appropriate  and  checks  the  re¬ 
sults,  passing  the  results  across  the  interface  to  the  decision- theoretic  sub¬ 
system  if  the  checks  are  passed.  If,  on  the  other  hand,  one  or  more  checks 
fail,  other  heuristics  are  invoked  and  a  further  set  of  checks  made,  with  the 
system  remaining  active  until  a  set  of  checks  is  passed  in  toto. 

This  type  of  system  can  be  modeled  as  a  production  system.  In  the  preced¬ 
ing  section,  we  outlined  a  production  system  representation  for  heuristics  in¬ 
volved  in  structuring  operations.  The  next  section  shows  how  an  embryonic 
form  of  such  a  system  is  currently  employed  in  MAUD.18  MAUD'S  production  sys¬ 
tem  is  probably  the  most  advanced  available  in  any  current  computer-based 
general  purpose  decision-aiding  device,  but  it  is  still  extremely  limited.18 
Before  we  can  go  further  in  building  and  testing  production  systems  to  handle 
structure  ordering  and  reordering  activities  in  decision  aids  involving  trans¬ 
actions  across  the  interface  with  semantic  memory,  we  need  a  better  understand¬ 
ing  and  specification  of  those  heuristics  that  might  be  useful  candidates  for 
inclusion  in  such  a  system.  Section  4  is  concerned  with  the  identification 
and  classification  of  such  heuristics. 


5.2  Production  System  Control  of  Structure  Orderin 


and  Reordering  Activities 

This  section  outlines  the  way  in  which  MAUD  (Humphreys  &  Wisudha,  1979) 
uses  a  production  system  to  control  the  structure  ordering  and  reordering 
heuristics  it  esploys  in  forming  a  preference  structure  described  in  terms  of 
fully  decomposed  assessments  of  part-worths  of  a  set  of  terminal  events  (out¬ 
comes)  on  utility-independent  attribute  dimensions.  This  system  is,  as  yet, 
in  its  early  infancy  and  has  limited  capability  within  a  circumscribed  area 
of  the  province  of  decision  theory.  However,  it  has  proved  very  successful 

18 

See  also  Humphreys  and  Wisudha  (1979,  sections  2  and  3). 

19 

Other  systems,  such  as  OPINT  (Selvidge,  1976;  Allen  et  al.,  1976)  have  com¬ 
prehensive  structure-reordering  devices  that  operate  within  a  decision-theo¬ 
retic  subsystem  (the  event  buffer  system  in  Figure  1  in  the  case  of  OPINT) . 
Such  systems  operate  according  to  normative  specifications.  While  they  are 
sometimes  organized  according  to  a  production  system,  they  are  not  considered 
here  because  they  do  not  necessarily  involve  the  invocation  of  heuristic 
devices. 


WJ 


in  practice ,  and  this  success  has  led  us  to  propose  that  much  more  flexible, 
comprehensive  systems  be  developed  as  soon  as  we  have  a  better  command  of  the 
building  blocks  for  such  systems:  structuring  heuristics  of  the  type  outlined 
in  section  4. 

Here  we  shall  be  concerned  only  with  the  control  of  the  section  of  MAUD 
that  deals  with  ordering  and  reordering  the  decomposed  preference  structure. 

Zt  is  interfaced  with  other  sections  of  MAUD,  which  handle  operations  such  as 
specification  and  revision  of  the  set  of  terminal  events  among  which  prefer¬ 
ences  are  to  be  traded  off  within  the  structure,  elicitation,  and  revision  of 
the  relative  value-wise  importances  of  the  attribute  dimensions  comprising  the 
current  preference  structure  and  so  on. 

Control  is  passed  to  this  section  of  MAUD  whenever  a  decision  maker  wishes 
to  order  (expand)  or  reorder  (revise)  the  preference  structure  currently  under 
consideration.  (Even  if  this  involves  interrupting  another  task  within  the 
decision  analysis,  the  ramifications  of  the  interruption  is  handled  at  a  higher 
level  of  control  within  MAUD.)  Control  within  the  section  resides  in  an 
APPLYLIST22  of  15  productions.  Each  production  (p)  is  of  the  form: 

P  :  {C-»A> 

where  C  is  a  vector  of  one  or  more  conditions  that  must  all  obtain  at  the 
moment  the  APPLYLIST  is  scanned  for  that  production  to  be  implemented.  A 
is  a  vector  of  one  or  more  actions  (procedures)  that  will  be  carried  out  by 
MAUD  upon  implementation  of  the  production.  Some,  but  not  all,  of  these  pro¬ 
ductions  will  involve  interaction  with  the  user.  The  actions  transform  the 
preference  structure,  and  they  also  set  appropriate  condition  flags  during 
their  execution.  Certain  condition  flags  may  also  be  set  at  any  time  by  the 
user  overriding  a  request  for  particular  input  by  MAUD  with  an  interruption.23 

These  productions,  and  their  order  of  priority  in  the  APPLYLIST,  are 
shown  in  Figure  8.  The  conditions  sensed  and  actions  taken  are  defined  as 
follows : 2^ 


See  Humphreys  (1978b)  for  a  report  of  the  use  of  this  system  with  a  wide 
range  of  decision  makers  and  an  analysis  of  gains  made  through  its  use. 

21 

See  Humphreys  and  Wisudha  (1979)  for  details  of  these  operations. 

22 

APPLYLIST  and  other  technical  terms  used  in  this  section  are  defined  in 
Appendix  A. 

23 

For  instance,  MAUD  may  request  ratings  of  terminal  events  on  an  attribute 
dimension,  but  the  user  may  reply  that  he  or  she  is -unhappy  with  the  current 
definition  of  the  dimension.  The  production  system  is  designed  to  handle  such 
interruptions  in  whatever  way  is  most  appropriate. 

24 

The  number  in  parentheses  after  each  condition  and  action  refers  to  the 
section  in  Humphreys  and  Wisudha  (1979)  in  which  these  conditions  and  actions 
are  described  in  detail. 
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APPLYLIST 


Comment 


PI  s  {C6 
P2  :  {C5 
P3  :  (C3 


A7> 

A5} 

A7,  A3> 


A13,  A9,  A10) 
A9 ,  A10} 


P6  s  {C15  -*•  A16} 

P7  :  {C14  -*•  A15} 

P8  s  {C13  -*•  A9,  AlO} 


P9  s  {C 12  -*■  A8,  All} 

PIO  :  {Cll  ■+  A12,  A18,  A14} 

Pll  :  {CIO  -*■  A5,  A6,  A17} 

P12  s  {C2  -*■  A4,  A19} 

P13  :  {c7  -*•  A4,  A19> 

P14  :  (Cl  &  C2  &  C16  •+  A2,  A3> 
P15  s  {Cl  *►  Al,  A3> 


user- initiated  deletion  to 
part  of  preference  structure 


user-initiated  change  of  content 
within  preference  structure 


consequences  of  failure  of  MAUD 
initiated  check  of  adequacy  of 
decision-theoretic  model 


MAUD- initiated  gathering  of 
content  within  preference  structure 


user-initiated  extension  of 
preference  structure 


no  further  ordering-reordering 
operation  required:  task  accomplished 


Note.  Productions  are  numbered  in  order  of  priority  of  execution  within  the 
APPLYLIST . 


Figure  8.  Productions  used  to  control  preference  structure 
ordering  and  reordering  activities  within  MAUD. 


(1)  Conditions 


Cl  ■  Ihe  decision  maker  using  MAUD  (the  user)  wishes  to  have  his  or 

her  semantic  memory  prodded  to  aid  the  elicitation  of  the  prefer¬ 
ence  structure  relevant  to  the  decision  problem  under  considera¬ 
tion  (i.e.,  tradeoffs  between  a  set  of  terminal  events,  or  out¬ 
comes  leading  to  the  formation  of  holistic  preference  values  for 
those  outcomes) .  (2) 

C2  -  User  is  willing  to  define  poles  of  an  attribute  dimension  on  the 

basis  of  the  current  (MAUD-generated)  elicitation  instruction.  (2 

C3  *  User  is  not  happy  with  current  definition  of  poles  of  an  attribute 
dimension.  (2) 

C4  -  User  is  not  happy  with  current  ratings  on  an  attribute 
dimension.  (2) 

C5  «  User  wishes  to  change  current  ratings  on  an  attribute 
dimension.  (2) 

C6  ■  User  wishes  to  cancel/delete  an  attribute  dimension  from  the 
current  preference  structure.  (2) 

C7  *  User  wishes  to  add  an  attribute  dimension  to  the  current 
preference  structure.  (2) 

C8  -  User  is  not  happy  with  the  current  position  of  an  ideal  point 
on  an  attribute  dimension.  (3.5.1) 

C9  *  More  than  two  attributes  are  in  current  preference  structure. 

CIO  »  Poles  of  an  attribute  dimension  are  defined,  but  ratings  of 

terminal  events  (outcomes)  on  the  scale  spanning  the  poles  are 
incomplete  or  absent.  (3.2) 

Cll  ■  J-scaled  (raw)  ratings  of  terminal  events  on  a  dimension  exist 
but  are  not  folded  about  the  current  ideal  point  on  that  dimen¬ 
sion  to  give  I-scaled  (preference)  ratings.  (3.5.1) 

C12  -  Ideal  point  is  not  currently  set  on  an  attribute  dimension. 

C13  «  Inadequate  variance  exists  in  I-scaled  ratings  on  an  attribute 

dimension.  (3.5.2) 

C14  ■  Statistical  independence  check  fails  between  I-scaled  ratings 

on  a  pair  of  attribute  dimensions.  (3.3.2) 

C15  -  Utility  independence  check  fails  in  thought  experiment  conducted 

by  MAUD  in  interaction  with  user.  (3.3.2) 

C16  “  Opposite  Method  heuristic  for  activating  semantic  memory 

failure  flag  not  set. 


(2)  Actions  (procedures  executed  by  MAUD) 

A1  ■  Use  Difference  Method  (DM)  heuristic  to  activate  semantic  memory 
concerning  attributes  to  be  added  to  the  current  preference 
structure.  (2) 

A2  »  Use  Opposite  Method  (OM)  heuristic  to  activate  semantic  memory 

concerning  attributes  to  be  added  to  the  current  preference 
structure.  (2) 

A3  *  Investigate  whether  user  wants  to  define  poles  of  a  new  attribute 
dimension.  (2) 

A4  =  Elicit  poles  of  new  attribute  dimension  from  user.  (2) 

A5  *  Elicit  rating  of  terminal  events  (outcomes)  currently  under 

consideration  as  a  J-scale  spanning  the  poles  of  the  current 
attribute  dimension.  (3.2) 

A6  =  Investigate  adequacy  of  J-scaled  ratings  on  current  attribute 

dimension.  (3.2) 

A7  »  Cancel/delete  current  attribute  dimension.  (2) 

A8  =  Elicit  ideal  point  on  current  attribute  dimension.  (3.5.1) 

A9  =  Give  user  the  option  of  canceling  current  attribute  dimension. 

(2) 

A10  -  Give  user  the  option  of  changing  his  or  her  J-scaled  ratings  on 

current  attribute  dimension.  (2) 

All  »  Check  whether  user  is  happy  with  the  current  position  of  his  or 
her  ideal  point  on  a  specified  attribute  dimension. 

A12  =*  Fold  J-scaled  ratings  about  the  ideal  point  on  an  attribute 

dimension  to  form  I-scaled  ratings.  (3.5.1) 

A13  *  Cancel  ideal  point  on  specified  attribute  dimension. 

A14  -  Check  I-scaled  ratings  on  current  attribute  dimension  for  statis¬ 

tical  independence  with  I-scaled  ratings  on  all  other  attribute 
dimensions  active  within  current  preference  structure.  (3.3.1) 

A15  ”  Conduct  thought  experiment  with  user  to  determine  whether 

specified  pair  of  attribute  dimensions  exhibit  utility 
independence.  (3.3.1) 

■  Delete  specified  (utility  nonindependent)  pair  of  attribute 

dimensions  from  current  preference  structures;  elicit  substitute 
pair  of  poles  (defining  new  dimension  within  current  preference 
structure ) .  (3.3.1) 


A16 


A17  «  Cancel  Opposite  Method  heuristic  failure  flag. 

A18  *  Check  for  adequate  variance  in  I-scaled  ratings  on  attribute 

dimensions.  (3.3.2) 

A19  <*  Check  whether  user  is  happy  with  the  definition  of  poles  of 

current  attribute  dimension.  (2) 

-  In  operating  the  production  system,  the  productions  on  APPLYLIST  shown 
in  Figure  8  are  scanned  in  order  of  priority,  always  starting  from  the  head  of 
list.  As  soon  as  a  condition  specified  in  a  production  is  matched  to  a  condi¬ 
tion  currently  obtaining,  the  action  implied  by  that  production  is  implemented 
in  the  sequence  shown.  On  completion  or  interruption  of  the  specified  actions 
(either  by  MAUD  or  the  user) ,  control  is  immediately  passed  to  the  search  of 
the  APPLYLIST,  which  is  scanned  again.  This  cyclical  procedure  continues  until 
the  APPLYLIST  is  scanned  completely  with  no  production  being  activated.  At 
this  point,  the  structure  ordering  or  reordering  task  is  complete,  and  control 
is  passed  back  to  a  higher  level  within  MAUD. 

This  system  has  the  great  advantages  of  being  flexible  and  capable  of 
rapid  expansion  in  future  developments  of  MAUD,  without  running  the  risk  of 
the  control  system  getting  out  of  hand  or  becoming  indeterminate  under  partic¬ 
ular  conditions.  It  also  gives  us  the  ability  to  use  and  check  heuristic  pro¬ 
cedures  in  an  efficient  way,  let  MAUD  and  the  user  share  the  direction  of  con¬ 
trol,  and  still  perform  efficient  housekeeping  activities  designed  to  minimize 
the  extent  of  incoherence  in  the  preference  structure  under  development.  More¬ 
over,  exit  is  not  possible  from  the  production  system  until  the  reordered  pref¬ 
erence  structure  is  coherent;  so  the  whole  system  can  serve  safely  as  a  module 
for  incorporation  in  a  larger  system,  because  it  has  only  a  single  entry  and 
exit  and  requires  no  external  control. 

Hie  system  is,  of  course,  still  limited,  but  our  experience  to  date 
indicates  that  it  will  serve  as  a  satisfactory  basis  for  the  development  of 
much  more  comprehensive  systems  in  the  future,  involving  many  more  heuristic 
devices  than  those  incorporated  in  the  current  version  of  MAUD. 


6 .  STRUCTURING  UNCERTAINTY 

In  section  3.1  we  discussed  two  systems  that  can  help  the  assessor  deter¬ 
mine  a  probability  distribution  for  some  target  event — PIP  systems  and  influ¬ 
ence  diagrams.  Both  systems  were  shown  to  act  as  buffers  between  the  assessor's 
semantic  memory  and  the  core  act-event  subsystem.  The  systems  facilitate  prob¬ 
ability  assessment  by  providing  structure,  usually  in  disaggregated  form,  to 
uncertainty  about  the  target  event. 

These  are  not  the  only  two  systems  that  can  perform  this  function.  As 
we  reviewed  systems  for  structuring  uncertainty,  it  became  clear  that  four 
fundamental  strategies  cover  all  the  structuring  systems  currently  in  use, 
as  well  as  those  we  could  imagine  might  be  helpful .  We  discuss  these  strategies 
in  the  next  section,  and  then  in  section  6 . 2  we  outline  a  new  buffering 
subsystem. 


6.1  Current  Systems 

An  individual  who  must  assess  uncertainty  about  some  target  event  can 
approach  the  problem  in  one  of  four  ways,  as  shown  in  Figure  9. 


Figure  9.  Ways  of  assessing  uncertainty 
about  some  target  event. 


Holistic  judgment  includes  not  only  carefully  considered  judgment  about 
the  target  event  itself,  but  also  judgment  based  on  relevant  historical  data. 
For  example,  uncertainty  about  projected,  sales  might  be  based  on  the  past  12 
months'  sales  figures,  adjusted  to  take  account  of  special  conditions  like 
inflation  or  new  sales  taxes  that  might  prevail  for  the  next  12  months. 
Strictly  speaking,  holistic  judgments  are  not  buffered;  semantic  memory  is 
linked  directly  to  the  core  act-event  subsystem.  However,  holistic  judgments 
are  made  frequently  in  most  decision  analysis,  so  this  strategy  for  assessing 
uncertainty  is  included  here  for  completeness. 

When  an  assessor  finds  that  uncertainty  about  the  target  event  is  diffi¬ 
cult  to  assess  because  probabilities  depend  on  other  events,  it  may  be  useful 
to  extend  the  conversation  to  include  these  other  events.  For  example,  if  the 
probability  assigned  to  event  E  is  thought  to  be  different  if  event  F  occurs 
than  if  it  does  not  occur,  then  the  assessor  could  be  asked  to  assess  the  con¬ 
ditional  probabilities  p(e|f)  and  p(e|f),  along  with  the  unconditional  proba¬ 
bilities  p (F)  and  p(F) .  The  probability  associated  with  event  E  can  then  be 
calculated: 

p(E)  -  p(E|F)p(F)  +  p(E|F)p(F) 

If  assessments  of  the  probabilities  associated  with  the  occurrence  and  nonoc¬ 
currence  of  F  prove  difficult  without  considering  event  G,  then  a  further  ex¬ 
tension  of  the  conversation  can  be  made  to  include  event  G.  In  this  way,  any 
number  of  related  events  can  be  considered.  Technologies,  or  buffering  sub¬ 
systems,  that  are  based  on  extending  the  conversation,  include  influence  dia¬ 
grams,  event  trees,  and  fault  trees.  At  a  theoretical  level,  there  is  no 
difference  between  these  three  technologies. 

Two  situations  may  lead  the  as sessor  to  use  Bayes*  theorem.  In  extend¬ 
ing  the  conversation,  the  assessor  may  be  required  to  assess  p(f|g)  but  may 
find  it  easier  to  think  about  and  assess  the  inverse  probability  p(g|f). 

The  earlier  probability  can  be  turned  into  the  required  probability  by  using 
Bayes'  theorem,  sometimes  called  the  theorem  of  inverse  probability: 

p(r,G)  .  EiliEME. 


This  type  of  structure  is  often  referred  to  as  "flipping  the  decision  tree." 

The  other  situation  in  which  Bayes '  theorem  is  useful  occurs  when  data  are 
available  that  affect  one's  uncertainty  about  the  target  variable.  The  PIP 
system  discussed  in  section  3.1  is  an  example;  we  might  call  this  buffering 
subsystem  a  simple  inference  structure.  Cascaded  inference  structures  are  also 
in  use.  Observable  data  reduce  uncertainty  about  some  unobservable  indicator 
or  factor,  which  in  turn  reduces  uncertainty  about  the  target  variable .  An 
example  can  be  seen  in  insurance  underwriting.  A  factory's  trash  disposal 
facilities  can  be  directly  observed.  Th°se,  along  with  other  data,  give  a 
fallible  indication  of  the  state  of  hous<  Seeping,  which  is  one  of  several 
factors  that  bear  on  the  degree  of  fire  risk  posed  by  the  factory.  Another 
exasple  is  that  of  sensor  uncertainty.  A  solid  sonar  return  is  a  fallible  in¬ 
dication  of  the  presence  of  an  enemy  submarine,  which  in  turn  has  some  bearing 
on  the  extent  of  future  hostilities  between  two  adversaries. 
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Another  way  to  disaggregate  the  target  event  is  to  determine  the  functional 
relationships  the  target  event  may  have  with  other  events.  If  the  target  event 
is  an  uncertain  quantity,  then  it  may  be  a  function  of  other  quantities,  some 
of  which  are  also  uncertain.  If  the  functional  relationship  between  the  target 
variable  and  these  other  variables  can  be  determined,  then  assessments  can  be 
made  of  the  uncertainty  associated  with  the  other  variables  and  the  probability 
distribution  over  the  target  variable  calculated  or  determined  by  Monte  Carlo 
simulation. 

All  of  the  uncertainty  structuring  systems  we  have  encountered  use  one 
or  more  of  these  four  strategies. 25 


6.2  Buffering  for  Functional  Relationships 

When  it  is  difficult  to  assess  uncertainty  about  some  target  event  because 
the  event  is  complex,  it  may  be  possible  to  determine  the  functional  relation¬ 
ship  of  the  event  to  other,  simpler  events.  Then  uncertainty  can  more  confi¬ 
dently  be  assessed  for  the  simpler  events.  A  probability  distribution  over 
the  target  event  can  be  calculated  if  the  functional  relationships  are  simple 
enough  for  this  procedure  to  be  mathematically  tractable  or  determined  by 
Monte  Carlo  simulation. 

Hhat  are  the  structural  elements  that  could  be  used  in  this  type  of  dis¬ 
aggregation?  Typically,  they  are  the  same  as  those  used  in  extending  the  con¬ 
versation:  events  (and  their  outcomes) ,  uncertain  quantities  and  probabilities 
associated  with  the  events,  or  uncertain  quantities.  Ibis  is  the  most  elemen¬ 
tary  level  of  disaggregation  familiar  to  decision  analysis.  However,  an  alter¬ 
native  level  of  disaggregation  may  often  be  more  useful,  especially  when  an 
interactive  computer  system  is  being  used. 

The  approach  can  be  illustrated  with  an  example.  One  of  the  authors  was 
asked  to  help  the  marine  claims  section  of  a  large  insurance  company  to  improve 
its  estimates  of  the  eventual  size  of  a  settlement  in  cases  of  damage  to  the 
hull  of  a  ship.  Soon  after  an  incident  occurs,  the  claims  department  is 
notified  of  the  accident.  They  are  given  only  a  brief  description,  but  the 
information  provides  a  rough  basis  for  judging  the  eventual  size  of  the  settle¬ 
ment  of  the  claim.  There  is  often  considerable  uncertainty  associated  with 
this  estimate.  (The  estimate  is  required  for  a  variety  of  reasons;  an  example 
is  that  reserves  must  be  set  aside  in  a  fund  out  of  which  claims  are  paid.) 

After  many  hours  of  discussion  with  the  head  of  the  section,  and  following 
many  revisions  and  alterations,  the  model  shown  in  Figure  10  evolved.  The 
eventual  size  of  the  settlement  can  be  expressed  as  the  product  of  four  quan¬ 
tities:  the  net  size  of  the  claim,  an  image  factor,  a  relationships  factor, 
and  a  handling  factor.  Each  of  the  last  three  factors  acts  as  a  multiplier 
that  could  increase  the  net  size  of  the  claim.  For  example,  circumstances 
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For  example,  Decisions  and  Designs,  Inc.,  has  produced  TREE,  an  interactive 
computer  program  for  decision  tree  modeling,  and  OPINT,  an  interactive  program 
that  includes  a  simple  prestructured  tree  with  a  single  target  event  whose  un¬ 
certainty  can  be  modeled  with  an  influence  diagram,  supplemented  (optionally) 
by  a  simple  inference  structure. 
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surrounding  the  claim  may  be  adverse,  which  could  lead  the  insurance  company 
to  pay  out  extra  sums  to  preserve  its  image.  Even  if  the  circumstances  are 
not  adverse,  the  multiplier  might  be  greater  than  one,  though  not  so  much  as 
if  the  circumstances  are  adverse.  Thus,  uncertainty  about  the  size  of  the 
factor  is  modeled  in  two  stages:  first,  probabilities  are  assigned  to  the 
circumstances  being  adverse  or  not  adverse;  and  second,  two  probability  dis¬ 
tributions  over  the  factor  are  assessed,  one  conditional  on  the  circumstances 
being  adverse,  the  other  on  their  not  being  adverse.  Similar  structures  hold 
for  the  relationships  and  handling  factors. 

The  net  size  of  a  claim  is  disaggregated  into  two  quantities,  the  total 
cost  less  the  net  costs  recoverable  from  a  third  party  (if  applicable) .  Total 
cost  is  further  disaggregated  into  the  size  of  the  loss  less  a  reduction  for 
negligence  plus  the  size  of  additional  payments.  Uncertainty  about  the  size 
of  the  loss  is  expressed  as  a  probability  distribution  over  that  quantity, 
which  is  bounded  by  the  deductible  at  the  lower  end  and  by  the  amount  of  the 
indemnity  at  the  upper  end.  A  reduction  for  negligence  may  not  apply;  if  it 
does,  and  this  is  assigned  a  probability,  then  the  policy  specifies  that  the 
size  will  be  10  percent  of  the  size  of  the  loss.  Additional  payments  may  not 
be  necessary;  if  they  are,  for  which  another  probability  is  assigned,  then  a 
probability  distribution  is  assessed  over  the  size  of  these  payments. 

Net  costs  recoverable  from  a  third  party  are  calculated  by  multiplying 
the  total  cost  by  a  proportion  of  the  total  cost  that  is  recoverable  from  a 
third  party.  Of  course,  costs  may  not  be  recoverable,  but  if  they  are  (with 
some  probability,  which  must  be  assessed) ,  then  a  probability  distribution 
over  the  proportion  must  be  assessed. 

In  the  figure,  the  shaded  boxes  identify  the  events  and  uncertain  quan¬ 
tities  for  which  probabilities  must  be  assessed.  Depending  on  the  structure, 
assessments  may  be  associated  with  discrete  events,  uncertain  quantities,  or 
uncertain  quantities  conditional  on  event  outcomes. 

Once  the  required  assessments  are  made,  a  probability  distribution  over 
the  eventual  size  of  a  settlement  can  be  obtained  by  Monte  Carlo  simulation. 

Note  that  each  shaded  box  represents  a  structure  based  on  the  simple 
ingredients  mentioned  above:  events  and  their  outcomes,  uncertain  quantities, 
and  probability  distributions.  However,  some  of  the  boxes  are  identical  in 
structure:  all  the  factor  boxes  are  the  same;  the  two  bottom  right  boxes  are 
also  the  same.  Is  it  possible  that,  at  this  level  of  structuring,  only  a  few 
structures  are  needed  to  represent  most  disaggregated  target  events?  If  so, 
then  these  few  structures  could  be  preprogrammed  in  a  computer  to  serve  as 
generic  building  blocks  that  would  enable  a  user  to  model  uncertainty  about 
almost  any  target  event. 


6.3  Modular  Uncertainty  Structure 

He  believe  that  there  arc  only  a  few  basic  structures;  we  call  them 
modular  uncertainty  structures  (MUSs) .  Although  many  more  structures  are,  of 
course,  possible,  we  think  that  those  listed  in  Table  2  should  be  sufficient 
for  most  problems. 
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Hote.  For  cases  3-9,  utilities  nay  be  expressed  directly  rather  than  as 
functions  over  consequences. 

^ist  of  structural  elements:  E:  event;  p:  probability;  U:  utility; 
C:  consequence;  f,g,h,i,j,k:  functions. 


He  cam  envisage  a  computer  program  that  includes  these  13  MUSs  as  the 
building  blocks  in  a  generic  structure-building  program.  Any  specific  model 
could  be  built  by  defining  disaggregated  variables  and  their  relationships, 
and  then  by  assigning  the  appropriate  MUS  to  each  disaggregated  variable. 

Each  MUS  used  would  then  request  the  appropriate  inputs  from  the  user.  Rou¬ 
tines  for  assessing  probability  distributions  could  be  included  in  the  program 
to  help  the  user  generate  coherent  assessments. 

Xt  is  possible  that  this  program  could  be  used  by  people  who  have  some 
technical  training  but  are  not  experts  in  decision  analysis.  By  raising  the 
structural  level  to  the  MUS  from  the  rather  molecular  level  used  by  decision 
analysts,  buffering  with  semantic  memory  systems  may  be  facilitated.  The  MUS 
structure  may  more  closely  represent  internal  structures  built  up  by  the  ex¬ 
pert  in  dealing  with  a  particular  class  of  problems  over  many  years. 


CONCLUSION 

The  reconceptualization  of  decision  theory,  presented  in  section  3  of  this 
report,  enabled  us  to  outline  the  current  limits  of  formal  decision  theory, 
and  to  go  on  in  sections  4,  5,  and  6  to  explore  beyond  these  limits,  with  a 
view  to  extending  decision-theoretic  methodology  into  the  field  of  structuring 
decision  problems.  In  section  4,  we  argued  the  case  for  the  development  of 
heuristic  aids  to  structuring  and  suggested  programmatic  guidelines  for  this 
development;  section  5  described  the  preliminary  implementation  of  some  such 
aiding  devices  within  the  structuring  capability  of  MAUD.  Section  6  pointed 
out  a  direction  for  further  work  in  aiding  the  structuring  of  uncertainties  by 
the  use  of  modular  uncertainty  structures.  The  implications  of  the  work  de¬ 
scribed  and  the  recomnendations  for  future  work  are  stated  explicitly  within 
each  section. 

What  remains  to  be  done  is  to  contextualize  these  research  efforts  within 
an  overview  of  the  procedures  involved  in  the  process  of  decision  structuring. 
He  suggest  such  an  overview  next,  decomposing  the  structuring  process  into  a 
series  of  operations  and  suggesting  where  within  this  serieB  the  candidate 
structuring  heuristics  isolated  in  Table  1  of  this  report  may  be  usefully 
employed . 

Our  review  of  the  currently  available  work  on  structuring  heuristics, 
summarized  in  Table  1,  has  led  us  to  identify  the  following  heurists  as  worthy 
of  further  investigation  as  candidates  for  inclusion  within  structuring  systems 

e  Representativeness:  a  search  instruction  for  making  judgments  about 
a  present  case  by  reference  to  a  class  encoded  in  memory. 

e  Causal  schemata:  A  model  of  the  world  accessed  from  memory  for 
judgment-making  about  present  cases. 

e  Availability  as  a  memory  search  instruction. 

e  Inter-  and  intra-attribute  comparison  and  assessment  of  attributes 
of  consequences. 


•  Search  procedure  determined  by  representation  of  attributes  of  conse¬ 
quences  as  bipolar  scales. 

e  Elimination-by-aspects  used  as  a  procedure  for  reducing  sets  of  options 
to  be  assessed. 

e  Systematic  scenario  generation:  a  strategy  for  eliciting  realistic 
consequences  of  actions. 

e  Conservative  heuristic  for  deleting  actions  from  option  set  by  compar¬ 
ing  observed  and  predicted  levels  of  attributes  (Sheppard's  investment 
manager's  heuristic). 

•  A  strategy  dictating  that  only  those  alternatives  approximating  to 
present  practice  are  included  in  the  option  set. 

However,  the  specification  of  some  candidates  for  inclusion  within  a  deci¬ 
sion-structuring  system  is  merely  one  step  toward  the  construction  of  such 
systems.  What  is  needed  in  addition  is  a  specification  of  a  structuring  sys¬ 
tem  architecture  into  which  each  of  these  candidates  may  be  fitted  to  aid  the 
structuring  of  decision  problems.  In  Figure  11  we  present  in  general  form  a 
proposed  architecture  for  such  systems. 

The  roles  of  both  the  environment  (represented  as  block  1  of  Figure  11) 
and  the  constantly  changing  content  of  the  decision  maker's  semantic  memory 
(represented  as  block  2  of  the  figure)  are  explained  in  section  4  and  in  Appen¬ 
dix  A.  The  right-hand  column  of  blocks  in  Figure  11,  presenting  fairly  gross 
descriptions  of  structuring  operations  necessary  for  providing  the  required 
inputs  to  a  decision- theoretic  evaluation  model,  concerns  us  here. 

If  the  decision  maker  has  recognized  that  a  decision  problem  exists, 
we  hypothesize  that  an  interactive  procedure  incorporating  the  operations  de¬ 
scribed  in  blocks  3  to  6  in  Figure  11  will  provide  inputs  crossing  the  inter¬ 
face  with  the  decision-theoretic  system  adequate  for  assessment  of  a  decision- 
theoretic  model  of  the  problem.  Thus*  the  operation  described  in  block  5 
provides  the  option  set  to  be  evaluated  within  the  decision-theoretic  core 
system  (see  Figure  3  .  Block  6  structures  those  uncertainties  arising 
within  the  decision  problem  necessary  for  numerical  assessment  within  the 
decision-theoretic  probability  buffer  system.  Block  8  provides  information 
concerning  the  criteria  for  evaluating  consequences  of  actions  necessary  for 
the  functioning  of  the  decision-theoretic  utility  buffer  system. 

Blocks  3,  4,  and  7,  while  not  directly  responsible  for  output  into  the 
decision-theoretic  system,  constitute  the  means  whereby  the  decision  maker 
constructs  an  internal  representation  of  the  problem  requisite  for  the  pro¬ 
duction  of  such  output.  The  decision  maker's  construction  of  an  understanding 
of  his  or  her  initial  state  (at  block  3)  is  a  necessary  condition  for  the 
categorization  of  the  decision  problem  at  block  4,  and  it  is  by  means  of  this 
categorization26  that  possible  action  plans  for  solving  the  problem  are  con¬ 
structed  at  block  5.  The  decision  maker's  understanding  of  his  goal,  con¬ 
structed  at  block  3,  not  only  conditions  the  action  plans,  constructed  at 
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See  von  Winterfeldt,  1980. 
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Figure  11.  Diagram  of  basic  operations  required  for  creating  a  decision 
structure  adequate  for  evaluation  by  the  decision-theoretic 
system. 
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block  5,  but  also  determines  the  criteria  used  for  evaluation  of  the  conse¬ 
quences  of  actions  at  block  8  in  conjunction  with  the  descriptions  of  conse¬ 
quences  of  actions  at  block  7. 

If  this  constitutes  a  viable  general  description  of  a  structuring  system 
architecture,  how  might  the  candidate  heuristics  referred  to  above  be  employed 
within  it?  Each  of  blocks  3  to  8  in  Figure  11  represents  the  site  of  operation 
of  one  or  more  of  the  candidate  heuristics,  as  summarized  in  Table  3. 

Rather  than  stating  all  of  our  reasons  for  assigning  each  heuristic  to 
each  structuring  site  in  Table  3,  we  will  concentrate  on  one  example — that  of 
representativeness.  Representativeness  may  be  a  useful  heuristic  in  circum¬ 
stances  in  which  it  is  appropriate  to  attempt  to  throw  light  on  the  present 
problem  by  reference  to  a  class  encoded  in  memory.  It  can  thus  be  useful  in 
categorizing  a  decision  problem,  represented  as  block  4  in  Figure  11.  However, 
in  reinterpreting  Tversky  and  Kahneman's  research  in  representativeness  in  sec¬ 
tion  4.4,  we  have  identified  a  further  site  of  structuring  operations  at  which 
representativeness  may  prove  to  be  of  help — namely  in  structuring  the  decision 
problem  in  such  a  way  that  uncertain  events  are  assigned  to  classes,  the  sub¬ 
sequent  numerical  assessment  of  probability  of  the  event  being  determined  by 
the  degree  of  fit  between  class  and  number.  Thus  it  appears  that  representa¬ 
tiveness  also  has  a  role  in  determining  the  output  from  block  6  of  Figure  11. 

These  heuristics  are  in  no  way  exhaustive  of  those  we  may  need  to  con¬ 
sider  in  developing  decision-structuring  systems,  and  we  consider  that  the 
best  way  to  proceed  is  to  start  with  systems  of  limited  scope  and  expand  the 
scope  in  interaction  with  decision  makers  facing  a  variety  of  decision-struc¬ 
turing  problems.  There  is  also  a  pressing  need  for  a  delineation  of  those 
structuring  activities  that  could  profitably  be  incorporated  within  a  computer- 
based  decision  aid,  and  those  that  would  reside  better  within  the  head  of  a 
decision  analyst.  It  is  our  contention  that  aiding  techniques  that  require 
knowledge  of  the  world  (or  a  simulation  of  the  current  contents  of  the  decision 
maker's  semantic  memory)  should  not  be  automated  because  any  device  doing  so 
would  have  also  to  be  programmed  with  an  enormous  data  base  that  would  have 
to  be  constantly  updated  in  the  light  of  new  information  from  every  conceivable 
source.  The  human  brain  is  likely  to  remain  the  best  information  processing 
and  storage  system  of  this  type,  at  least  within  the  forseeable  future. 

He  consider  that  such  decision  structuring  systems  should  be  controled 
through  a  production  system  organization  of  the  type  now  in  use  (in  embryonic 
form)  in  MAUD  and  outlined  in  section  5. 


Table  3 


Sites  of  Operations  of  Structuring  Heuristics 


Site  of  structuring  operations 


Suggested  heuristics  operating  at  site 


Represent  initial  state 
and  goal 
(block  3) 

Categorize  the  problem 
(block  4) 


Construct  action  plans 
(block  5) 


Specify  relevant  uncertainties 
(block  6) 


Specify  consequences  of 
alternative  actions 
(block  7) 


Construct  criteria  for 
evaluation  of  consequences 
(block  8) 


Causal  schemata 
Availability 


Representativeness 
Causal  schemata 
Availability 

Elimination-by-aspects 
Sheppard's  investment  manager's 
heuristic 

Access  choice  options  approximating 
to  present  practice 
Availability 

Representativeness 

Causal  schemata 

Systematic  scenario  generation 

Availability 

Inter-  and  intra-attribute  information 
search 

Systematic  scenario  generation 
Availability 

Search  procedure  determined  by 
representation  of  criteria  as 
bipolar  scales 
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APPENDIX  A 


PRODUCTION  SYSTEMS  AND  SEMANTIC  MEMORY 


The  production  system  (PS)  provides  a  convenient  tool  for  representation 
of  methods,  almost  irrespective  of  how  the  researcher  is  disposed  to  analyze 
them.  Whichever  answers  are  favored  to  all  the  technical  questions  concerning 
the  representation  of  knowledge,  a  specific  PS  system  architecture  can  be  de¬ 
signed  for  their  specification.  Whether  a  theory  requires,  for  example,  serial 
(Newell  £  Simon,  1972) ,  or  parallel  (Anderson,  1976)  implementing  of  processes, 
or  a  mixture  of  the  two  (Newell,  1973) ;  whether  its  short-term  memory  data 
base  is  last-in  first-out  or  first-in  first-out;  or  whether  an  n-slot  model  of 
short-term  memory  (Newell,  1973)  is  used,  or  it  is  modeled  as  an  active  parti¬ 
tion  of  an  associative  network  in  long-term  memory  (Anderson,  1976) ,  the  PS 
representation  provides  a  precise  and  convenient  modeling  tool. 

All  the  contents  of  any  structured  data  base,  of  which  that  conventionally 
called  long-term  memory  by  experimental  psychologists  is  of  principal  interest 
in  personalist  decision  analysis,  may  be  represented  as  procedural  knowledge 
(knowing  how)  as  in  the  Newell  (1973)  model.  Thus  Newell  takes  long-term 
memory  to  consist  entirely  of  an  ordered  set  of  productions.  Alternatively, 
our  knowledge  of  procedures  and  our  declarative  knowledge  of  facts  about  the 
world  may  be  separately  represented.  Anderson's  (1976)  model,  which  he  calls 
ACT,  is  of  this  type.  In  ACT,  declarative  knowledge  is  represented  as  a 
propositional  network  encoded  in  semantic  memory,  while  goal-seeking  methods 
and  procedures  are  specified  as  production  systems.  The  propositional  network 
is  composed  of  complex  configurations  of  nodes  and  links.  Anderson  (1976, 
p.  147)  describes  these  as  follows: 

The  nodes  in  the  network  such  as  ACT  are  intended  to  represent  "ideas" 

....  The  links  represent  access  relationships  or  associations.  That 
is,  the  links  represent  which  ideas  can  lead  to  (elicit)  each  other. 

Factual  knowledge  is  represented  as  a  set  of  propositions  encoded  in  memory, 
the  structure  of  each  proposition  being  encoded  as  a  set  of  nodes  and  relations 
(links)  between  nodes.  Syntactic  principles  are  invoked  as  a  check  upon  the 
validity  of  propositions. 


Heuristics,  specified  as  production  systems,  operate  on  this  propositional 
network,  which  constitutes  the  structured  data  base  accessed  by  the  decision 
siaker.  Production  systems  are  invoked  both  to  perform  judgmental  tasks  (the 
output  from  the  system)  and  to  encode  new  propositions  into  the  semantic  memory 
network.  The  structure  and  content  of  the  network  both  determine  which  pro¬ 
ductions  can  be  invoked  and  provide  the  data  structure  that  motivates  the  im¬ 
plementation  of  particular  productions,  in  the  manner  outlined  in  Figure  A-l. 
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Figure  A-l.  steps  in  the  operation  of  a  production  system  processing  inputs 
and  outputs  across  interface  between  semantic  memory  and  a 
decision-theoretic  system.  (The  interfacing  is  shown  in  Figure  3.) 


Productions  are  implemented  as  a  result  of  a  match  between  the  conditions 
of  productions  and  the  contents  of  active  memory.  The  matching  check  is  per¬ 
formed  on  a  subset  of  the  total  repertoire  of  productions  available  to  the  sub¬ 
ject.  This  subset  is  composed  of  those  productions  that  are  potentially  appro¬ 
priate  to  the  task  environment  and  is  labeled  the  APPLYLIST .  An  initial  check 
of  active  memory  is  required  to  draw  up  the  APPLYLIST.  Hence,  access  to  the 
propositional  network  is  required  at  two  separate  stages  of  production  imple¬ 
mentation!  in  drawing  up  an  APPLYLIST  of  potentially  appropriate  productions, 
and  in  the  selection  from  the  APPLYLIST  of  those  productions  to  be  implemented. 
However,  access  is  restricted  solely  to  that  portion  of  the  subject’s  memory 
that  is  currently  active. 

Any  artificial  model  that  purports  to  have  psychological  significance 
must  restrict  memory  access  so  that  all  encoded  elements  are  not  accessible 
at  any  one  moment  in  time.  Newell  (1973)  achieves  this  by  restricting  the 
data  structures  that  form  the  bases  for  the  implementation  of  productions  to 
a  Short-term  memory.  Anderson's  (1976)  model,  on  the  other  hand,  is  such 
that,  while  the  implementation  of  a  production  system  will  draw  further  nodes 
and  links  into  active  memory,  the  selection  of  a  particular  production  system 
for  implementation  is  determined  by  an  initial  activation  of  memory,  and  it 
is  this  active  portion  alone  that  is  accessible. 

The  structure  and  content  of  this  activated  portion  of  memory  are  the 
result  of  the  decision  maker's  structuring  of  the  task  environment.  The  main 
report  discusses  how  the  activation  is  done,  using  detailed  examples. 
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